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designed  to  maximize  the  effectiveness  and  efficiency  of  decision  making  by  an 
expert  board  of  5  or  7  members.  Levels  of  prediction,  reliability,  item  dis¬ 
persion,  and  patterns  of  item  priorities  between  expert  panels  were  found  to  be 
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Executive  Summary 


Purpose 


The  objectives  of  this  research  were  to  develop  and  apply  systematic  and 
reliable  procedures  1)  to  identify  and  describe  major  and  specific  subarea 
medical  combat  service  support  deficiences,  2)  to  prioritize  subareas  within 
each  major  mission  area,  3)  to  prioritize  the  major  mission  areas,  and  4)  to 
provide  the  Army  Mission  Area  Analysis  (MAA)  Program  with  an  Army  Medical 
Department  (AMEDO)  submission  of  medical  combat  deficiencies  and  proposed 
corrective  actions  for  input  to  the  Training  and  Doctrine  Command  (TRADOC) 
and  the  Department  of  the  Army  (DA)  MAA  planning  and  budgeting  cycle. 

Approach 


Medical  combat  service  support  capabilites  and  deficiences  were 
identified  through  the  use  of  a  computer  simulated  war  game  scenario  (Europe 
III  -  Sequence  2  Alpha).  The  exercise  assessed  the  1986  US  force  structure 
against  the  1992  Soviet  Warsaw  pact  threat  in  the  theater  of  combat 
operations.  Initially  68  subarea  deficiencies  within  13  medical  functional 
areas  were  identified  through  front-end-analysis  and  corrective  actions  were 
specified.  Due  to  limited  budgetary  and  technological  resources,  not  all 
areas  can  or  will  be  funded  or  developed.  Therefore,  it  was  critical  to 

identify  the  top  medical  combat  priorities. 

Two  7-member  panels  of  experts  with  over  300  years  of  collective 

military  medical  experience  were  employed  to  prioritize  the  major  and 

subarea  deficiency  lists.  The  first  panel  consisted  of  six  colonels  and  one 
lieutenant  colonel  who  comprised  the  Force  Integration  Committee  (FIC)  of 

the  Academy  of  Health  Sciences,  Ft  Sam  Houston,  TX.  The  second  panel,  the 
AMEDO  General  Officer  Board,  consisted  of  five  general  officers  and  two 
senior  colonels  representative  of  major  AMEDO  organizations. 

The  Iterative  Decision  Method  (IDM)  developed  for  this  project  is  a 

qroup  productivity  technique  designed  to  maximize  the  effectiveness  and 

efficiency  of  decision  making  by  an  expert  board  of  5  or  7  members.  The 
procedure  consisted  of  a  nominal  group  phase  in  which  members  rendered 
independent  expert  priority  judgments  (Jl)  of  deficiency  items.  The  Jl 

decisions  were  statistically  modeled  using  multiple  linear  regression 
equations.  Feedback  results  that  iden'.'fied  item  priorities  and  areas  of 
disagreement  were  presented  to  panel  members.  Experts  then  made  revised 

group  judgments  (J2)  based  upon  the  interpretation  of  the  Jl  results. 
Revised  results  from  the  FIC  group  prioritization  decisions  (J2)  served  as 
input  to  the  General  Officer  Board  judgments  (Jl). 

V 

Results 


Levels  of  prediction,  inter-rater  reliability,  item  dispersion,  and 
patterns  of  specific  item  priorities  between  the  two  expert  panels  were 
found  to  be  highly  similar.  In  addition,  the  experts  indicated  that  the 
results  were  accurate,  that  the  process  utilized  their  expertise,  and  that 
they  were  confident  in,  and  satisfied  with  the  obtained  results. 
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Final  item  rank  priorities  (J2)  from  the  AMLDD  General  Officer  Board 
were  rescaled  to  0-1.0  values  and  were  submitted  with  the  MAA  results  to  the 
Logistics  Center,  Ft  Lee  Virginia,  to  be  incorporated  into  the  combat 
service  support  MAA  for  submission  to  TRADOC  and  DA.  The  final  prioritized 
list  of  medical  combat  deficiencies  included:  (1)  Casualty  Care  and 

Treatment,  (2)  Casualty  Prevention,  (3)  Medical  Resources,  (4)  Casualty 
Evacuation,  (5)  Prevention  and  Medical  Treatment  in  Chemical  Warfare,  (6) 
Medical  Command,  Control,  and  Communication/Intell i gence,  (7)  Prevention  and 
Medical  Treatment  in  Biological  Warfare,  and  (8)  Prevention  and  Medical 
Treatment  in  Nuclear  Warfare. 

Specific  results  for  the  three  most  important  deficiency  areas  are 
outlined  below.  The  top  five  ranked  items  are  listed  for  each  area. 

Casualty  Care  and  Treatment  items  included  1)  resuscitation  capabilities, 
2)  medical  and  surgical  capabilities,  3)  self  and  buddy  aid,  4)  treatment 
regimes  for  directed  energy  injuries,  and  5)  diagnosis  and  treatment  of 
combat  stress  reactions.  Casualty  Prevention  items,  ranked  by  importance 
were  1)  eye  protection  from  high  velocity  fragments  and  high  intensity 
electromagnetic  radiation,  2)  detection,  identification,  and  early  warning 
of  disease,  3)  recognition,  monitoring,  and  correction  of  heaHh  hazards 
to  crews  and  friendly  forces,  4)  doctrine  and  training  for  the  prevention 
of  combat  stress,  and  5)  environmental  protection  for  patients  in 
evacuation.  Of  28  items  within  Medical  Resources,  the  top  five  included 

1)  combat  zone  and  communications  zone  (COMMZ)  medical  treatment  facilities, 

2)  COMMZ  hospital  augmentation  and  reconstitution  of  corps  level  treatment 
facilities,  3)  medical  resupply  support,  4)  clinical  laboratory  capacity, 
and  5)  medical  materiel,  supply,  and  equipment  decontaminants. 

The  top  ranked  items  for  the  remaining  deficiency  areas  were:  air 

and  ground  vehicles  within  Casualty  Evacuation,  chemical  prophylaxis, 
antidotes,  and  theraputics  for  Prevention  and  Treatment  in  Chemical 
Warfare,  major  systems  (  PLRS/JTIDS  Hybrid,  SINCGARS,  IHFR,  etc.)  within 
Medical  Command,  Control,  and  Communication  /  Intelligence,  detection 
equipment  to  identify  biological  contamination  within  Prevention  and 

Medical  Treatment  in  Biological  Warfare,  and  radiological  prophylaxis, 
antidotes,  and  theraputic  compounds  within  the  Prevention  and  Medical 
Treatment  in  Nuclear  Warfare  area. 

Mission  Impact 

Implications  of  the  prioritization  results  for  management  and 
training  decisions  are  discussed.  Considerations  are  based  upon  both 

the  major  combat  service  support  areas  and  the  prioritized  subareas  within 
each  major  area.  Potential  uses  of  the  IDM  process  are  also  explored. 

In  all,  the  project  modeled  over  2,000  expert  decisions  and  constitutes 
a  defensible  and  comprehensive  basis  for  the  priority  of  US  Army  medical 
combat  service  support  deficiencies  and  required  corrective  actions. 
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Prioritization  of  Medical  Combat  Deficiencies: 
Application  of  the  Iterative  Decision  Method 


INTRODUCTION 

The  United  States  Army  Medical  Department  (AMEDD)  is  faced  with  crucial 
financial,  managerial,  and  technological  decisions  pertaining  to  short-  and 
long-term  medical  combat  requirements.  Medical  research,  development,  and 
training  priorities  set  today  will  impact  the  Army's  state -of-the -inedicai- 
art  and  combat  performance  in  the  year  2000.  Through  the  identification  and 
prioritization  of  deficiencies,  specific  medical  programs  may  be  targeted 
and  corrective  actions  may  be  taken  in  order  to  deliver  the  appropriate 
medical  and  health  care  services  on  future  battlefields. 

The  purpose  of  this  study  was  to  develop  and  apply  systematic  and 
reliable  procedures  1)  to  identify  and  describe  major  area  and  specific 
subarea  medical  combat  deficiencies,  2)  to  prioritize  subareas  within  each 
of  the  major  medical  combat  deficiency  areas,  3)  to  prioritize  the  major 
deficiency  areas,  and  4)  to  provide  the  Army  Mission  Area  Analysis  (MAA) 
Program  with  an  AMEDD  submission  of  medical  deficiencies  and  proposed 
corrective  actions. 

Mission  Area  Analysis 

The  Army  MAA  Program  is  an  integral  part  of  the  DOD  MAA  program  and 
consists  of  an  ongoing  examination  of  specific  mission  elements  1)  to 
determine  deficiencies  related  to  operations  concepts,  tactics, 
organization,  training,  and  materiel  systems,  2)  to  propose  feasible 
solutions  to  correct  deficiencies,  3)  to  identify  opportunities  for 
capitalizing  on  advances  in  technology,  and  4)  to  provide  a  set  of 
prioritized  mission  requirements  for  use  in  evaluating  present  systems  and 
developing  future  systems. 

The  Army  Training  and  Doctrine  Command  (TRADOC)  is  responsible  for 
conducting  analyses  of  US  Army  missions  for  air  defense,  light  and  heavy 
close  combat,  fire  support,  communications,  and  combat  support  for 
engineering,  mine  warfare,  nuclear-biologica  I -chemical  (NBC)  warfare,  and 
support  services.  Analysis  of  the  combat  service  support  mission  area  falls 
under  the  authority  of  the  Army  Logistics  Center  at  Ft  Lee,  Virginia,  and 
consists  of  projects  related  to  capabilities  for  supply,  maintenance,  field 
services,  transportation,  personnel  and  administration,  communications,  and 
medical  support.  This  particular  study  documents  the  MAA  activities 
directed  to  medical  combat  service  support  deficiencies  and  was  conducted  by 
the  Directorate  of  Combat  Development  and  Health  Care  Studies  at  the  Academy 
of  Health  Sciences,  Ft  Sam  Houston,  Texas. 

Medical  combat  service  support  capabilities  and  deficiencies  were 
identified  thrcuah  the  use  of  SCORES  (Scenario  Oriented  Recurring  Evaluation 
System),  a  computer  simulated  war  game  technique.  Scenario  results  provided 
predictions  of  medical  support  requirements,  i.e.,  number  of  beds,  staffing, 
types  and  frequency*  of  medical  treatment,  supplies,  etc.  Requirements  were 
computed  from  various  combinations  of  casualty  rates,  types  of  wounds,  troop 
strength,  weapons  employed,  and  terrain  and  environmental  conditions. 
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Medical  support  requirements  were  then  matched  against  projected 
available  medical  resources  to  isolate  areas  of  adequate  versus  deficient 
coverage.  Forecasts  were  made  based  upon  historical  battlefield  trends  and 
medical  statistics  from  World  Wars  I  and  II  and  the  Korean  and  Vietnam 
conflicts  (e.q. ,  Neel,  1973:  Reister,  1973).  The  particular  scenario 
employed  for  this  project  involved  threat  reactions  and  responses  of  the  US 
Army  5th  and  7th  Corps  medical  units  and  other  medical  units  which  would  be 
deployed  in  the  European  theater  of  operations  under  conventional,  chemical, 
and  nuclear  warfare  conditions.  The  scenario  used,  Europe  Ill-Sequence  2 
Alpha,  was  run  in  a  1986-1992  time  frame  which  assessed  the  1936  US  force 
structure  aqainst  the  1992  Soviet  Warsaw  pact  threat.  Major  deficiencies 
identified  through  this  procedure  included  areas  impacting  upon  medical  and 
surqical  treatment;  force  structure;  logistics;  evacuation  and  regulation; 
optical,  dental,  and  veterinary  services;  preventive  medicine; 
communications;  blood  bank  services,  ana  NBC.  Individual  subarea 
deficiencies  were  further  specified,  refined,  and  analyzed  by  medical 
subject-matter-expert  panels  composed  of  consultants  from  the  Office  of  The 
Surqeon  General,  personnel  from  the  Medical  Research  and  Development 
Command,  AHS  instructors,  and  medical  personnel  assigned  to  Brooke  Army 
Medical  Center,  Ft  Sam  Houston,  Texas.  (See  Appendix  I  for  a  complete  list 
of  the  initial  major  and  subarea  deficiencv  items.) 

Once  the  major  and  subarea  medical  combat  deficiencies  were  identified, 
the  next  step  in  the  project  was  to  select  an  appropriate  decision-making 
method  to  prioritize  the  deficiency  lists.  The  following  section  outlines 
the  requirements  and  rationale  used  for  the  selection  of  a  systematic  and 
reliable  decision-makinq  method. 

Alternative  Approaches  to  Decision  Making 

Group  versus  individual  decisions.  Decision-making  act’ons  may  be 
viewed  as  a  form  of  productivity.  Within  a  productivity  approach,  judgments 
can  be  assessed  along  the  dimensions  of  effectiveness  and  efficiency.  To  be 
effective,  decisions  should  be  accurate,  be  centered  upon  appropriate 
issues,  be  understandable,  and  be  useful  as  an  integrated  product.  To  be 
efficient,  decision-making  actions  should  be  timely,  De  arrived  at  in  an 
orderly,  systematic  manner,  and  be  parsimonious  in  the  expenditure  of 
resources. 

Outputs  from  small  groups  have  typically  been  found  to  exceed  outputs  of 
single  individuals  (Baron,  Byrne,  &  Griffitt,  1974;  Hiddlebrook,  1974; 
Rosenberg,  1969).  An  extensive  literature  review  of  small  group  and 
individual  productivity  from  1920  to  1957  (Lorge,  Fox,  Davitz  &  Brenner, 
1958)  presented  evidence  in  favor  of  group  versus  individual  performance 
across  a  variety  of  performance  tasks.  For  example,  groups  were  shown  to  be 
more  accurate  than  individuals  in  judgments  of  the  weight  of  physical 
objects  (Bruce,  1935),  in  the  detection  of  small  words  within  large  words 
(Watson,  1928),  in  judgments  of  social  situations  (Eysenck,  1939),  and  in 
the  solution  of  other  complex  problems  (Shaw,  1932).  More  recently,  Davis 
(1969)  demonstrated  that  cognitive  and  intellectual  task  performance  may  be 
enhanced  by  group  activity. 
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In  terms  of  efficiency,  however,  some  research  has  shown  that  an 
individual  may  be  more  productive  in  organizing  activities  if  action 
requires  a  high  degree  of  coordination  in  a  short  period  of  time  (Kelley  & 
ihibaut,  1 9  u  9 ) . 

The  practice  of  collective  decision  making  has  long  been  recognized  by 
the  military  as  evidenced  by  numerous  boards  for  personnel  selecion, 
promotion,  and  disciplinary  actions.  In  addition,  boards  are  routinely 
convened  for  the  selection  and  prioritization  of  tasks  fo.’  training,  for 
budget  and  funding  actions,  and  for  mission  and  program  planning  functions. 

Nominal  versus  interactive  group  decisions.  Although  group  decisions 
tend  to  be  superior  to  individual  decisions  in  terms  of  productivity, 
different  approaches  may  be  taken  to  arrive  at  a  group  decision.  Are 
members  of  a  board  more  effective  and  efficient  in  decision  making  if  they 
work  individually  or  if  they  accomplish  most  of  the  work  in  face-to-face 
meetinqs?  This  question  addresses  the  difference  between  nominal  and 

interactive  qroup  structures.  For  example,  a  decision-making  task  could 
consist  of  the  selection  of  four  out  of  ten  eligible  candidates  for 

promotion.  In  the  nominal  group  mode  board  members  make  their  selections 

independently  and  record  their  choices.  When  the  board  is  convened,  the 
individual  lists  are  combined  and  reviewed.  Those  candidates  which  most 
frequently  appear  on  the  lists  are  then  recommended  for  promotion.  In  the 
interactive  group  mode,  board  members  meet  and  formulate  their  ordered 
choices  based  upon  discussion  and  mutual  information  exchange.  The  end 
Droduct  in  each  case  is  a  prioritized  list  of  primary  and  alternate 

candidates  which  reflects  a  collective  board  decision. 

Comparative  research  studies  of  decision  making  in  small  groups  suggest 
that  there  are  different  distinct  advantages  associated  with  the  use  of 
nominal  versus  interactive  groups  (Marquart,  1955;  Taylor,  1954). 
Differences  in  performance  may  be  attributable  to  three  main  factors,  viz, 
the  nature  of  and  difficulty  associated  with  the  objects  that  are  judged, 
characteristics  of  the  group  members  who  make  the  judgments,  and  the 
situation  in  which  the  judgments  are  rendered. 

In  reference  to  judgmental  difficulty,  both  groups  tend  to  function 
equally  well  for  simple  unitary  task  decisions  (Kelley  i  Thibaut,  1969).  As 
decisions  become  more  complex,  interactive  groups  tend  to  perform  more 
accurately  and  tend  to  be  more  satisfied  with  their  performance.  For 
example,  in  an  experiment  by  Faust  (1959),  both  nominal  and  interactive 
qroups  attempted  to  solve  a  series  of  simple  spatial  problems.  Solutions  of 
the  two  groups  were  very  similar.  However,  for  complex  verbal  problems  that 
involved  scrambled  words,  the  interactive  group  performed  significantly 
better  than  did  the  members  of  the  nominal  group. 

Morris  (1966)  studied  task  difficulty  effects  in  relation  to  production, 
discussion,  and  problem-solving  tasks.  Three  hundred  and  twenty-four  under¬ 
graduates  rated  27  standard  tasks,  nine  for  each  task  type.  Subjects  were 
then  divided  into  108  three-person  groups  and  interacted  in  the 
accomplishment  of  the  tasks.  Interaction  was  assessed  by  a  Bale's 
interaction  analysis  system.  Correlations  between  the  subjects'  difficulty 
ratings  and  facets  of  the  group  interaction  process  showed  that  difficult 


tasks  were  associated  with  more  structuring  of  answers,  seeking  evaluation 
from  others,  and  significantly  less  irrelevant  activity  which  may  be  viewed 
as  more  efficient  performance. 

Hackman  (1968)  has  also  shown  that  characteristics  of  task  difficulty 
and  task  type  (production,  discussion,  and  problem  solving)  influence  the 
nature  of  group  performance.  In  this  study,  members  participated  in  tasks 
at  low,  medium,  and  high  levels  of  difficulty.  Hackman  found  that  written 
products  from  more  difficult  tasks  tended  to  be  more  original  and  issue- 
involved  while  products  from  the  easier  tasks  proved  to  be  less  original  or 
issue- involved  but  of  higher  grammatical  and  rhetorical  quality. 

Shiftlett  (1972)  incorporated  both  interpersonal  interaction  and  task 
difficulty  variables  in  a  study  addressed  to  task  performance  and  member 
satisfaction.  Group  members  worked  on  both  easy  and  difficult  crossword 
puzzles  under  three  interaction  strategies  consisting  of  autonomous  labor- 
nominal  grcuo,  divided  labor  (one  person  solved  horizontal  words  while  the 
other  person  solved  vertical  words  of  the  same  puzzle),  and  shared  labor 
(both  subjects  of  a  dyad  solved  the  puzzle  by  mutual  agreement).  Dependent 
measures  consisted  of  the  correct  number  of  words  solved,  perceived 
difficulty,  and  attitudes  toward  the  task.  Performance  scores  and 
difficulty  ratings  for  the  easy  tasks  were  significantly  different  from 
scores  and  ratinqs  for  hard  tasks.  Performance  main  effects  revealed  that 
the  highest  performance  occurred  in  the  shared  labor  strategy  followed  by 
divided  labor  and  individual  effort.  The  same  pattern  was  repeated  for  the 
member  satisfaction  attitudes. 

In  a  recent  review,  Hackman  and  Morris  (1975)  stressed  the  importance 
that  moderating  effects  of  the  group  interaction  process  and  task 
characteristics  have  upon  satisfaction  and  performance  outcomes. 

Numerous  studies  have  investigated  the  moderating  effects  of  task 
difficulty  and  interpersonal  interaction  upon  performance  and  consequent 
satisfaction  and  arrived  at  similar  findings  (Trow,  1957;  Ewen,  1973;  and 
Bray,  Kerr,  fc  Atkin,  1978). 

Three  central  concerns  separate  the  nominal  from  the  interactive  process 
in  regard  to  the  characteristics  of  group  members.  First,  a  nominal  group 
maintains  a  higher  degree  of  impartiality  because  members  make  their 
decisions  individually.  Independent  action  limits  the  amount  of  influence 
that  board  members  may  exert  upon  others  (Van  de  Ven  &  Delbecq,  1971;  cf. 
Torrance,  1957).  Second,  by  discussion,  members  tend  to  stimulate  thoughts 
that  other  members  might  not  have  if  they  work  alone  (Hall,  Mouton,  &  Blake, 
1963;  Jones  &  Geraud,  1967).  Third,  an  interactive  group  benefits  from  a 
pooling  of  immediate  resources  while  the  nominal  group  does  not.  In  terms 
of  accuracy,  face-to-face  interaction  provides  opportunities  for  errors  to 
correct  themselves,  for  clarification  of  issues,  and  for  the  analysis  of  the 
loqic  behind  member  decisions  (Delbecq,  Van  de  Ven,  &  Gustafson,  1975). 
Numerous  studies  have  examined  the  pooling-of-abilities,  skills,  and 
knowledges  issue  (Goldman,  1965,  1966;  Goldman,  McGlynn,  &  Toledo,  1967; 
Johnson  &  Torcivia,  1967;  Laughlin  &  Johnson,  1966;  lorge  &  Solomon,  1955; 
Shaw,  1971;  and  Steiner,  1966,  1972).  While  the  majority  of  these  studies 
confirmed  the  obvious  advantages  of  the  pooling-of-abilities  effect  on 


4 


decision  making  in  interactive  groups,  findings  also  indicated  that  the 
effect  was  contingent  on  a  high  level  of  member  ability.  In  groups  composed 
of  experts,  each  member  has  unique  specialized  information,  skills,  and 
experiences  that  enhance  collective  decision  making.  In  interactive  groups 
composed  of  individuals  with  relatively  low  ability  or  knowledge  of  the 
issues,  few,  if  any,  gains  were  observed  beyond  the  productivity  of  nominal 
group  conditions. 

In  reqard  to  situational  effects  upon  the  productivity  of  decision¬ 
making  actions,  the  amount  of  time  allowed  for  solutions  appears  to  be  one 
of  the  major  factors  affecting  both  interactive  and  nominal  group  conditions 
(Davis  &  Restle,  1963;  Restle  &  Davis,  1962;  Restle,  1962).  Not 
surprisinqly,  solution  times  have  been  found  to  be  greater  as  the  complexity 
of  problems  increases  (Lovelace  &  Snodgrass,  1971;  Moyer  &  Landauer,  1967; 
Parkman,  1971;  and  Potts,  1974). 

Optimal  group  size.  Another  situational  factor  primarily  related  to 
interactive  group  productivity  involves  the  size  of  the  decision-making 
group.  Steiner  (1966,  1972)  hypothesized  that  productivity  generally 

increases  with  the  size  of  the  group  up  to  a  point  where  coordination  and 
motivation  decrements  take  over.  Group  interaction  affects  performance  and 
consequent  satisfaction  by  producing  coordination  decrements  in  the  efforts 
of  individual  group  members  and  by  producing  motivation  decrements  in  the 
1  ewel  of  effort  qroup  members  will  exert  on  a  group  task.  In  the  case  of 
coordination  effects,  the  larger  the  group,  the  greater  will  be  the  process 
loss  due  to  the  requirement  of  all  members  functioning  in  a  concerted 
manner.  For  motivation  effects,  member  effort  is  generally  expected  to 
decline  as  group  size  increases  since  adding  more  persons  to  the  group 
decreases  the  individual  amounts  of  any  outcome  reward  associated  with  the 
task. 

Support  for  these  factors  has  been  found  for  several  types  of 
performance  measures.  For  instance,  Z i 11 er  (1957)  found  that  decision 
accuracy  increased  74%  when  the  performance  of  one  person  was  compared  with 
the  performance  of  a  3-person  group.  However,  increments  in  productivity 
tended  to  be  smaller  as  more  people  were-  added  to  the  group,  i.e.,  when  the 
group  was  increased  from  three  to  six  members,  accuracy  increased  only  nine 
percentage  points.  In  a  more  recent  study,  Ingham,  Levinger,  Graves  and 
Peckham  (1974)  conducted  a  replication  of  the  classical  Ringelmann  effect 
which  shows  that  performance  decreases  as  group  size  increases  in  a 
tug-of-war  (rope  pulling)  task.  Subjects  were  102  male  students  assigned  to 
groups  ranging  from  one  to  six  members.  Performance  scores,  as  recorded  by 
an  electronic  rope  strain  gauge,  dropped  significantly  as  group  size  was 
increased  from  one  individual  to  two  or  three,  but  leveled  off  with  the 
addition  of  a  fourth,  fifth,  or  sixth  team  member.  The  investigators 
interpreted  the  finding,  that  increases  in  group  size  are  inversely  related 
to  individual  performance,  as  general  support  for  Steiner's  coordination- 
decrement  and  motivation-decrement  hypotheses. 

Several  other  studies  have  investigated  coordination  decrements 
associated  with  increased  group  size.  James  (1951)  reported  that  members 
experienced  difficulty  in  coordinating  groups  of  more  than  seven  persons. 
Delbecq  et  al  (197-$}.  have  also  shown  that  as  size  increases  above  some  limit 
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(about  size  seven)  that  restraints  against  participation  increase. 
Middlebrook  (1974)  states  that  "in  groups  of  more  than  eight  or  10, 
maintaining  contact  with  others  in  the  group  may  be  highly  difficult." 
Finally,  in  a  study  by  Hare  (1962)  it  was  found  that  as  groups  were 
increased  from  five  to  12  members,  the  amount  of  consensus  that  resulted 
from  group  discussion  decreased. 

In  addition  to  the  mechanics  of  coordination,  motivation  is  inversely 
affected  by  increases  in  the  size  of  interactive  groups.  Both  Shaw  (1960) 
and  Thelen  (1949)  found  that  motivation  and  levels  of  involvement  were 
higher  in  two  to  five  member  groups  than  in  six  to  eight  member  groups.  A 
study  by  Slater  (1958)  employed  groups  of  from  two  to  seven  members. 
Results  indicated  that  groups  of  size  five  were  most  satisfied  with  com¬ 
mittee  size.  Larger  groups  complained  of  ineff iciency,  while  smaller  groups 
became  mere  concerned  with  interpersonal  relations.  These  findings  were 
affirmed  in  studies  by  Hare  (1952,  1962)  where  five-person  groups  reported 
more  satisfaction  with  discussion  than  did  12-member  groups.  Hare  concluded 
that  in  groups  of  less  than  five  members,  persons  felt  the  group  was  too 
small  although  the  amount  of  available  discussion  time  per  member  was 

increased.  Above  size  five,  members  tended  to  feel  that  participation  was 
restricted. 

With  respect  to  the  optimal  size  for  interactive  discussion  groups, 

several  investigators  recommend  a  size  of  five  (Bales,  1954;  Slater,  1958; 
Hare,  1962),  while  others  recommend  a  range  from  at  least  fi«e  to  seven 
members  (Delbecq  et  al,  1975;  James  1951;  and  Van  de  Ven,  1974).  Groups  of 
less  than  five  participants  probably  lack  the  diversity  of  skills  under  the 
pooling-of-abilities  model  in  terms  of  the  total  number  of  critical 

judgments  required  for  an  accurate  group  decision.  Also,  in  groups  of  five 
or  more  it  has  been  found  that  the  opinions  given  are  generally  more 

carefully  thought  out  before  they  are  presented  (Hare,  1962).  These 
findings  indicate  that,  for  optimal  productivity,  interactive  decision¬ 
making  groups  should  consist  of  at  least  five  but  no  more  than  seven 

members.  Further,  the  use  of  an  odd  number  of  members  is  recommended  to 

circumvent  the  possibility  of  a  deadlock.  An  additional  advantage  of  five 
or  seven  member  qroups  is  that  when  disagreements  do  occur,  the  majority  and 
minority  positions  are  usually  quite  similar  in  size,  i.e.,  three  versus  two 
or  four  versus  three,  and  are  not  perceived  as  radical  departures  from  the 
qroup  position  (Hare,  1962). 

In  summary,  the  evidence  from  the  research  literature  indicates  1)  that 
collective  discussions  are  more  productive  than  decisions  made  by  a  single 
individual,  2)  that  nominal  group  structures  are  most  useful  for  making 
unitary  task  decisions  and  for  maintaining  impartiality,  and  3)  that 
interactive  groups  of  five  or  seven  experts  are  most  productive  for  making 
complex  decisions  when  pooling-of-abilities  is  required  aid  tend  to  be  more 
satisfying. 

Maximizing  decision  productivity  for  boards  of  experts.  Many  special 
purpose  techniques  exist  for  modeling  expert  judgments  and  decision-making 
actions.  These  approaches  may  be  loosely  classified  into  four  major 
categories.  The  first  cateqory  consists  of  basic  prioritization  models  and 
deals  with  ranking  (e.g.,  Q-sort  and  the  method  of  paired  comparisons)  and 
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scaled  ratings  of  stimuli  (Kerlinger,  1272).  The  second  major  category  is 
concerned  with  the  generation  of  decision  alternatives  and  choice  models 
such  as  the  Delphi  survey  technique  (Turoff,  1970),  the  nominal  group 
technique--NGT  (Delbtcq  et  al.,  1975;  Van  Dusseldorf,  1971;  Vreman  &  Watson, 
1974;  and  Vroman,  1975),  and  the  training  front-end-analys i S--FEA  method 
(Harless,  1975).  4  third  category  consists  of  policy-capturing  and  judgment 
analysis  models  based  largely  upon  multiple  linear  regression  techniques 
(Christal,  1968,  a,  b;  Hoffman,  1960).  The  last  general  category  deals  with 
mathematical  models  based  on  subjective  expected  utility  (SEU),  decision 
optimization,  and  valence-instrumentality-expectancy  (VIE)  theories  (Kaplan 
&  Schwartz,  1975,  1977;  Rosenberq,  1969;  and  Shelly  &  Bryan,  1964).  Of 
these,  the  first  two  categories  primarily  concentrate  on  decision  results 
whereas  the  latter  pair  focus  upon  the  psychological  and  cognitive  dynamics 
underlying  the  decision-making  process. 

The  four  categories  of  judgment  models  can  be  differentiated  by  the  type 
of  group  structure  used  (nominal  versus  interactive)  and  the  types  of 
judgments  employed  for  deciding  among  objects  or  items.  Each  of  the  four 
categories  will  be  briefly  reviewed  and  considered  in  terms  of  productivity 
for  group  decision  making. 

Prioritization  models  use  nominal  samples  of  judges  to  order  a  given  set 
of  objects  or  statements.  The  Q-sort  technique  usually  employs  50-100  item 
cards  that  are  sorted  by  judges  into  prioritized  categories  along  some 
dimension  such  as  important-unimportant  or  desirable-undesirable.  An 
averaqe  or  median  score  is  then  computed  for  each  item.  In  the  method  of 
paired  comparisons,  judqes  evaluate  each  item  against  every  other  item  and 
indicate  either  which  of  the  two  items  is  more  important  or  if  the  items  are 
of  equal  imuortance.  Using  this  technique  with  n  =  50  items  would  result  in 
n(n-l )/2=l ,225  pair-wise  judgments  per  person.  A  score  for  each  item  is 
tallied  by  the  number  of  times  judges  selected  it  over  other  items.  Both 
the  Q-sort  and  the  method  of  paired  comparisons  are  ipsative  measures 
meaning  that  each  judge's  set  of  decisions  has  the  same  arithmetic  average 
and  standard  deviation  as  those  of  the  other  judges  in  the  group.  While 
both  techniques  are  somewhat  effective  and  produce  sound  prioritized  lists 
of  items,  they  do  not  capitalize  on  pool-of-abilities  and  may  be  inefficient 
(time  consuming),  i.e.,  pair-wise  comparisons  of  50  items  by  seven  judges 
would  require  a  great  deal  of  time  for  each  judge  to  make  over  1,000 
separate  decisions  and  for  the  data  coding  and  analysis  of  some  8,575 
collective  group  judgments. 

Scaled  ratinqs  can  also  be  used  by  group  members  to  prioritize  items 
along  an  importance  dimension.  Ratings  are  typically  obtained  from  5-,  7-, 
or  9-point  ratinq  scales  (i.e.,  1  =  least  important  to  7  =  most  important) 
and  are  averaged  across  judges  to  produce  an  item  score.  While  this 
procedure  is  quicker  than  other  prioritization  methods,  the  drawback  of 
using  normative  ratings  is  that  many  or  all  of  the  items  may  be  assigned  a 
most  important  rating,  thereby  blurring  the  just-noticeable-differences 
amonq  items. 

Models  for  generating  alternative  items  and  choosing  among  alternatives 
often  use  both  nominal  and  interactive  groups.  With  the  Delphi  technique  a 
nominal  group  of  experts  is  surveyed  and  asked  to  list  decision  alternatives 
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for  some  problem.  An  interactive  staff  team  then  summarizes  the  various 
alternatives  from  the  independent  experts.  The  summarized  results  are 
returned  to  the  experts  for  review,  and  the  experts  are  asked  to  prioritize 
the  alternatives  and  mail  their  votes  back  to  the  staff  team.  The  staff 
then  computes  item  scores  for  eacn  of  the  alternatives  and  the  top 
alternatives  are  selected.  While  the  Delphi  has  been  shown  to  produce  very 
effective  results,  the  process  requires  extensive  survey  time  and 
coordination  to  develop  items  as  well  as  to  prioritize  them. 

The  nominal  group  technique  (NGT)  uses  the  same  experts  for  both  a 
nominal  and  an  interactive  group.  The  NGT  consists  of  four  steps  which 
include  1)  the  silent  generation  of  ideas  in  writing,  2)  an  independent 
preliminary  vote  on  the  importance  of  the  ideas  which  are  summarized  by 
simple  rank-orders  or  average  ratings,  3)  an  interactive  discussion  of  the 
preliminary  vote  results,  and  4)  a  final  vote  by  the  group.  Although 
statistically  weak,  the  NGT  does  capitalize  on  the  separate  advantages  of 
both  nominal  and  interactive  groups  and  could  probably  be  modified  for  use 
with  an  existing  set  of  alternatives  ( i . e . ,  MAA  deficiency  items). 

Harless'  weiqhted  factor  alternative  model  for  front-end-analysis  uses 
an  interactive  training  staff  to  structure  decisions  about  training 
problems.  The  technique  includes  1)  comparing  model  performance  against 
actual  performance  to  identify  deficiencies,  2)  determining  if  the  root 
cause  of  the  deficiency  is  due  to  a  lack  of  skills  and  knowledges,  3) 
describing  alternative  training  approaches  and  assumptions,  4)  deriving 
decision  factors,  value  scales,  and  factor  weights,  5)  computing  weighted 
factor  scores  for  each  alternative,  and  6)  assigning  priorities  to  the  sum 
of  the  weighted  factor  scores  for  each  alternative.  While  this  model  is 
systematic  in  producing  priorities  for  a  limited  number  of  alternatives,  it 
is  primarily  concerned  with  training  issues  and  does  not  contain  a  round  of 
nominal  qroup  judgments. 

The  third  category  of  models,  policy  capturing  and  judgment  analysis, 
employs  relatively  large  nominal  groups  of  expert  raters  to  evaluate  given 
sets  of  items  or  objects.  The  intent  of  these  techniques  is  to  have  raters 
provide  ranks  or  relative  scaled  ratings  that  serve  as  a  judgment 
criterion.  Numerous  measurements  of  other  variables  that  are  hypothesized 
to  be  functionally  related  to  or  predictive  of  judgments  are  also  taken. 
Employing  multiple  linear  regression  techniques,  the  judgment  criterion  is 
reqressed  upon  the  predictor  variables  to  determine  the  degree  of 
relationship  among  the  predictors  and  the  criterion.  Prediction  equations 
can  be  written  for  individual  members  and  grouped  into  a  single  equation 
usinq  hierarchical  clustering  procedures  (judgment  analysis),  or  equations 
may  be  developed  for  the  qroup  as  a  whole  (policy  capturing).  The  promotion 
candidate  example  given  previously  will  serve  to  demonstrate  the  usefulness 
of  the  policy  capturing  approach.  Nominal  group  members  each  rank  order  10 
candidates  for  promotion  from  top  to  bottom.  Lists  could  be  averaged  to 
obtain  each  candidate's  criterion  rank  score.  We  could  then  hypothesize 
that  education  and  performance  reports  contributed  to  the  raters'  decisions. 

If  the  education  (E)  and  performance  (P)  scores  for  each  person  were 
available,  the  criterion  scores  could  be  regressed  upon  the  E  and  P  scores. 
The  resulting  multiple  correlation  coefficient  R  would  indicate  the  strength 
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of  the  relationship  between  the  E  and  P  information  and  the  candidates' 
ranks.  Examination  of  the  least  squares  regression  weights  of  the  resulting 
equation  would  reveal  the  influence  of  either  E  or  P  upon  the  group's 
candidate  placement.  If  the  R.  is  high,  then  candidates  with  low  E  and  P 
scores  would  appear  lowest  on  the  group's  list,  and  those  four  canidates 
with  highest  E  and  P  scores  would  be  highest  on  the  list  and  would  be 
selected.  Incidentally,  the  character  of  the  least  squares  regression 
equation  is  such  that  the  linear  combination  of  the  weights,  wi  and  w?, 
times  the  respective  averages  for  the  predictor  variables,  E  and  P,  plus  the 
^egression  constant  c  will  always  equal  the  average  criterion  judgment  score 
Y.  The  functional  form  for  the  example  is: 

Y  =  W!  E  +  w2  P  +  c.  [1] 

The  chief  advantage  of  the  judgment  policy  equation  is  that  once  it  is 
set  or  "captured,"  predicted  rank  scores  can  be  calculated  for  new  items 
(candidates)  that  have  variable  scores  (E  and  P)  but  have  never  been 
evaluated  directly  by  the  expert  board.  For  instance,  a  medical  combat 
deficiency  list  could  involve  several  surgical  procedure  criteria.  If  a 
nominal  board's  policy  was  captured  for  this  list,  new  deficiency  items, 
i.e.,  other  surgical  procedures,  could  be  placed  into  the  existing 
prioritized  list  by  application  of  a  policy  equation  based  on  associated 
predictors.  Possible  combat  related  factors  might  be  physical  trauma, 
instrument  sterility,  surgical  staff  workloads,  etc. 

The  statistical  techniques  associated  with  these  models  are  extremely 
powerful  in  modeling  nominal  decisions  and  appear  to  tap  some  of  the 
underlying  logic  of  a  group's  decision.  However,  individual  group  members 
do  not  have  the  benefit  of  face-to-face  interaction  that  would  likely  modify 
their  initial  independent  policies  when  making  revised  group  decisions.  In 
addition,  the  decision  models  are  not  as  efficient,  in  terms  of  time,  as  the 
other  methods  discussed  because  many  hypothesized  variables  in  addition  to 
the  criterion  decisions  must  be  gathered,  coded,  and  analyzed. 

The  fourth  category  of  decision-making  models  includes  subjective 
expected  utility  (SEU),  decision  optimization,  and  valence-instrumentality- 
expectancy  (VIE)  techniques.  Of  several  theoretical  motivation  approaches 
taken  to  this  area,  instrumentality-valence  theory  as  initially  advanced  by 
Vroom  (1964)  and  others  (Hackman  &  Porter,  1968)  has  perhaps  proven  to  be 
the  most  prominent.  (See  Mitchell  &  Biglan,  1971,  and  Heneman  &  Schwab, 
1972,  for  reviews.) 

The  principle  judgment  components  of  VIE  theory  concern  the  valence  of 
rewards  or  outcomes,  the  instrumentalities  of  those  valences,  and  the 
subjective  expectancies  associated  with  a  series  of  instrumental-valences  in 
predicting  performance  and  satisfaction  outcomes. 

Item  decisions  under  these  models,  like  the  Harless  FEA  model,  are 
concerned  with  developing  composite  scores  for  several  alternatives  based 
upon  prioritized  components  or  factors.  Unlike  the  FEA  model,  groups  are 
nearly  always  nominal  in  structure,  and  the  set  of  alternative  outcomes  are 
specified  before  the  decision  making  takes  place.  Items  are  typically 
measured  in  terms  of  their  probability  of  leading  to  a  certain  outcome. 
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Studies  of  occupational  choice,  personnel  turnover,  and  joO  satisfaction 
have  used  these  techniques  with  mixed  success  (DeLeo  &  Pritchard,  1974; 
Mitchell,  1974).  The  mathematical  sophistication  involved  with  measurement 
of  many  variables  places  these  techniques  with  those  of  judgment  analysis 
and  policy  capturing  models  due  to  the  amount  of  time  required  for  data 
collection,  coding,  analysis,  and  interpretation.  Likewise,  the  techniques 
lack  the  use  of  interactive  group  decision  making. 

From  this  overview  it  has  been  shown  that  nominal  group  decisions  can  be 
used  in  two  ways.  First,  decision  information  may  be  used  directly  ?. s  an 
end  product.  Second,  results  can  be  input  to  an  interactive  group 
decision.  As  shown  for  the  the  Oelphi  and  NGT  methods,  group  decisions 
benefit  from  sequencing  nominal  and  interactive  actions.  In  this  regard, 
the  nominal  judgments  may  be  viewed  as  a  form  of  front-end-analysis  for  the 
interactive  round  of  decision  making. 

The  following  group  decision-making  model  was  developed  to  maximize  the 
judgment  productivity  for  a  board  of  experts.  Each  of  the  components  of  the 
procedure  has  been  carefully  structured  to  optimize  decision-making 
effectiveness  and  to  limit  inefficient  actions.  Analogous  to  the  medical 
model,  independent  judgments  for  nominal  groups  which  will  be  defined  as  Jl, 
may  be  viewed  as  an  aid  to  diagnosis,  i.e.,  they  provide  information  about 
the  present  state  of  a  given  decision-making  situation.  Revised  group 
judgments,  which  will  be  defined  as  J2,  involve  a  prognosis  for  the 
corrective  actions  to  be  taken.  J2  provides  a  forecast  of  the  course  that  a 
specific  deficiency  will  take  in  the  future.  Because  of  the  limited 
financial  and  technological  resources  available  to  the  DOD,  not  all  combat 
deficiencies  will  be  targeted  for  and  receive  corrective  action.  Therefore, 
it  is  vital  that  the  most  important  medical  combat  deficiencies  be 
identified. 

The  Iterative  Decision  Method  (IDM)  is  a  judgmental  process  structured 
to  capitalize  on  the  Jl -02  sequence  and  the  efficient  and  effective  elements 
contained  in  several  of  the  decision-making  techniques  discussed.  Figure  1 
displays  the  general  integration  of  specific  aecision-making  processes  that 
the  IDM  is  based  upon.  As  shown,  nominal  (Jl)  and  iterative  (J2)  groups  are 
alternated.  In  addition  to  the  separate  advantages  of  using  both  types  of 
groups,  the  combined  use  of  a  nominal  group  first  and  a  discussion  group 
second  results  in  an  increase  in  effectiveness.  Research  on  NGT  and  Delphi 
procedures  indicates  that  when  Jl  results  are  used  as  feedback  during  the  J2 
sequence  that  the  aggregation  of  group  judgments  increases  the  accuracy  of 
the  judgments  (Delbccq  et  al.,  1975;  Jaeger,  1982)  and  allows  the  members  to 
arrive  at  decisions  which  reflect  true  group  preferences  (Huber  &  Oelbecq, 
1972).  In  addition  to  the  NGT  and  Delphi  findings,  other  investigations 
have  consistently  shown  that  the  accuracy  of  decisions  increases  and  the 
range  of  judgments  decreases  after  group  discussion  (Jenness,  1932; 
Thorndike,  1938;  and  Timmons,  1942). 

To  improve  the  efficiency  of  the  process,  deficiency  items  or  task  lists 
are  developed  by  a  front-end-analysis  (FEA)  staff  before  the  decision-making 
process  begins.  The  use  of  FEA  frees  the  expert  panel  from  the  job  of 
generating  or  creating  the  judgment  items  prior  to  making  decisions. 
Specific  item  or  task  attribute  and  background  information.  Including 
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Sequencing  of  Interactive  and  nominal  groups  (similar  to  NGT  and  Delphi  processes) 
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potential  solutions  to  problem  areas,  are  also  assembled  by  the  FEA  staff 
and  made  available  to  experts  prior  to  the  Jl  meeting.  During  the  Jl  round 
of  judgments,  decision  makers  impartially  provide  simple  decisions  in 
reference  to  the  judgment  items.  For  the  selection  of  tasks  for  training, 
decisions  are  either  yes  or  no.  For  the  ranking  of  items,  a  small  Q-sort 
procedure  is  employed  to  provide  independent  item  priorities.  This 
procedure  is  more  efficient  than  the  verbal  round  rooin  sessions  of  the  NGT 
where  each  member's  idea  is  recorded  on  a  flip  chart  before  voting  *akes 
place.  While  simple  averages  help  to  differentiate  among  items  (or  tasks), 
explicit  measures  of  agreement  for  items,  computed  from  multiple  linear 
regression  equations,  provide  a  more  comprehensive  and  efficient  picture  of 
the  Jl  decision  results.  Predictive  information  consists  of  item  variables 
or  both  item  and  judge  variables  which  do  not  require  the  collection  of 
information  in  addition  to  the  decisions  themselves.  The  use  of 
standardized  graphic  results  allows  the  J2  members  to  efficiently  direct  the 
group  discussion  and  to  focus  on  disagreements  which  merit  attention.  The 
only  reason  that  agreed  upon  items  would  be  discussed  is  to  identify  the 
rationale  used  to  arrive  at  the  decisions.  While  this  information  might  be 
interesting,  it  is  secured  at  the  expense  of  time  which  would  be  better 
directed  to  the  pressing  problem  areas.  For  the  sake  o*  efficiency, 
differing  expert  positions  are  only  identified  when  they  are  associated  with 
disagreement.  In  addition  to  the  enhancement  cf  expert  decision 
productivity,  the  IDM  provides  an  accurate  audit  trail  of  the  entire 
decision-making  process. 

The  validity  associated  with  the  use  of  the  Jl  -  J2  technique  depends 
upon  two  requirements.  First,  the  FEA  must  be  comprehensive  and  cover  the 
full  domain  of  possible  judgment  items.  The  quality  of  the  decision  output 
directly  reflects  the  quality  of  the  input  items;  if  the  deficiency  lists 
are  incomplete  the  resulting  J2  prioritization  will  also  be  incomplete. 
Second,  experts  must  be  cooperative  and,  as  a  sample,  be  representative  of 
the  decis’on-maker  population.  They  should  also  have  performance-based 
abilities  and  experiences  with  reference  to  the  domain  of  judgments. 

The  iterative  nature  of  the  method  is  designed  to  quantify  expert 
opinions  (Jl)  and  to  refine  the  opinions  through  discussion  (J2).  Recent 
research  indicates  that  opinions  formed  on  the  basis  of  direct  experience 
are  more  consistent  with  subsequent  behavior  than  opinions  derived  from 
external  sources  such  as  persuasive  communication  or  other  indirect  means 
(Reaqan  &  Fazio,  1977;  Fazio,  Zanna,  &  Cooper,  1978).  With  this  form  of 
decision  making  there  are  no  correct  or  incorrect  opinions,  however,  the 
probability  of  100X  consensus  for  all  Jl  decisions  is  very  unlikely.  The 
objective  of  the  process  is  to  have  the  group  arrive  at  an  acceptable  level 
of  agreement;  it  is  not  necessary  that  1004  consensus  be  obtained.  Some 
expert  disagreement  is  required  for  the  process  to  work.  Indeed,  too  much 
agreement  might  indicate  1)  that  the  domain  of  items  is  restricted,  2)  that 
the  judgments  regarding  the  items  require  little  or  no  discrimination,  3) 
that  some  board  members  are  not  experienced  enough  to  consider  the 
complexity  of  the  issues,  or  4)  that  undue  pressure  or  influence  among  group 
members  has  produced  a  "rubber-stamp"  effect. 
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METHOO 


Selection  of  Expert  Panels 


Two  panels  of  experts  were  employed  in  the  present  study.  The  first 
panel  was  selected  from  the  Academy  of  Health  Sciences  (AHS)  at  the  request 
of  the  Directc"  of  Combat  Development  and  was  made  up  of  the  seven  member 
AHS  Force  Integration  Committee  ( F IC) .  The  J 1 -02  decision-making  method  was 
employed  with  the  FIC  experts  and  used  the  initial  MAA  list  compiled  by  the 
combat  developments  staff.  The  revised  group  list  produced  as  an  output 
from  the  FIC  became  the  input  for  a  second  round  of  judgments  rendered  by  a 
board  of  seven  AMEDD  general  officers  or  their  representatives.  Members  of 
the  General  Officer  Board  were  selected  to  insure  that  each  of  the  primary 
policy-making  organizations  of  the  Army  Medical  Department  were 
represented.  Members  of  both  panels  were  contacted  by  telephone  and 
provided  with  a  read-ahead  package  which  contained  the  MAA  deficiency  lists 
and  a  description  of  the  prioritization  method.  Both  expert  panels  were 
convened  during  July,  1982,  at  AHS. 

The  IDM  Process  for  Ipsative  Measures  (Rank  Data) 

The  Iterative  Decision  Method  (IDM)  was  developed  by  the  Individual 
Training  Division  of  AHS  for  the  selection  and  prioritization  of  AMEDD  tasks 
for  training  (Finstuen,  Note  1).  The  process  does  not  make  decisions,  but 
rather  provides  information  to  guide  the  decisions  of  an  expert  military 
board.  The  process  was  originally  designed  for  dichotomous  (1-0)  selection 
ratings  and  3-  or  7-point  prioritization  ratings.  The  IDM  has  been  used  in 
several  research  projects  at  the  Academy,  most  recently  in  the  Advanced 
Medical  Specialist  91830  study  (Carrol  &  Finstuen,  Note  2).  The  ranking 
procedure  described  in  this  paper  is  a  special  application  of  the  IDM  and 
consists  of  several  steps  as  shown  in  Figure  2. 

Procedures  and  instrumentation.  Medical  combat  deficiency  statements 
were  transcribed  onto  decks  of  3  x  5  cards.  Panel  members  sorted  the  card 
decks,  one  deck  for  each  of  the  13  major  deficiency  lists,  so  that  the  items 
judged  to  be  more  important  were  at  the  top  and  those  items  of  lesser 
importance  were  at  the  bottom  of  the  deck.  (See  Fig.  3  for  an  example  of 
the  process.)  Experts  were  asked  to  work  independently  and  provide  their 
own  individual  rank  orders. 

Independent  judgments  were  statistically  analyzed  with  a  series  of 
special  application  API  computer  programs.  In  addition  to  standard 
descriptive  statistics,  i.e.,  average  item  ranks  and  standard  deviations, 
three  statistical  indices  were  computed  for  each  list.  Indices  reflected 
the  goodness-of-f it  for  a  group  equation  which  expressed  the  individual 
judgments  as  a  function  of  a  set  of  binary  item  predictor  variables  (McNeil, 
Kelly,  &  McNeil,  1975;  Ward  &  Jennings,  1973),  an  index  of  the  inter-rater 
reliability  based  on  intra  class  correlation  (Finstuen  &  Campbell,  1979; 
McNemar,  1979;  Myers,  1979;  Johnson,  >.'ones,  Butler,  &  Main,  1981),  and  an  £ 
test  which  expressed  the  results  of  testing  the  hypothesis  of  item  rank  mean 
differences  (Guilford  &  Fruchter,  1973).  The  three  statistical  indices 
provided  interrelated  feedback  information  about  the  J1  decisions  in  much 
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OBJECTIVE :  To  nave  a  panel  of  k  persons  rank  order  a  list  of  n  items. 


Example  for 
k  •*  5  persons 
n  =  12  items 


List  Nr. 

Item  description 

1 

Alfa 

2 

Bravo 

3 

Charlie 

4 

Delta 

5 

Echo 

6 

Foxtrot 

7 

Golf 

8 

Hotel 

9 

India 

10 

Juliette 

11 

Kilo 

12 

Lima 

To  aid  their  judgments- 
panel  members  consider 
sub  item  attributes 
described  in  a 
reference  list 


PROCESS:  Force  rank  sorting  of  item  cards  by  panel  members 


1.  Each  panel  member  sorts  cards  into  5  piles  with  at  least  2-3  cards  per 
pile  ranging  from  least  important  (Left)  to  most  important  (Right). 


Least 

Important 


2.  Starting  with  the  most  important  pile,  members  order  their  cards  from 
high  to  low.  They  then  order  the  next  most  important  pile,  and  so  on, 
until  all  piles  have  been  prioritized. 

3.  Members  then  collate  their  cards  and  go  through  the  entire  deck 
’  one  last  time  to  "fine-tune"  the  item  order. 


Figure  3.  Rank  order  prioritization  procedures 


ANALYSIS :  Card  orders  from  all  panel  members  are  entered  Into  a  decision  matrix. 

For  example —  _  ,  w  , 

r  t» 1  Average 


Panel  Member 


Nr. 

Item 

A 

B 

C 

D 

E 

Item  rank 

1. 

1 

Alfa 

3 

3 

3 

2 

3 

2.8 

2 

Bravo 

1 

1 

2 

1 

2 

l.H 

2. 

3 

Charlie 

2 

2 

1 

3 

1 

1.8 

4 

Delta 

6 

7 

4 

6 

6 

5.8 

5 

Echo 

8 

5 

8 

5 

7 

6.6 

6 

Foxtrot 

5 

4 

6 

9 

4 

5.6 

7 

Golf 

9 

8 

7 

12 

8 

8.8 

3. 

8 

Hotel 

4 

5 

5 

4 

5 

4.8 

9 

India 

10 

9 

10 

7 

12 

9.6 

10 

Juliette 

11 

11 

11 

8 

11 

10.4 

4. 

11 

Kilo 

7 

10 

9 

11 

10 

9.4 

12 

Lima 

12 

12 

12 

10 

9 

11.0 

5. 

6.5  since 
forced  ranks  are  ipsative  measures. 


computed. 

A  group  equation  is  ccmputed 
to  express  the  overall  rank 
order  agreement  of  the  entire 
panel. 

A  goodness-of-fit  measure  jl 
for  the  equation  is  computed. 

The  reliability  of  the  rank 
averages  /v  ^  is  computed. 

Test  of  the  hypothesis  for 
significant  differences 
among  average  item  ranks  F. 


RESULTS : 


A  graph  is  produced  based  upon  the  group  equation  which  prioritizes  the 
items  and  indicates  the  amount  of  agreement-disagreement  among  the  p^nel. 

Final  Rank  Item  (List  Nr.) 
R  -  .23  - ' 


/°55* 


.96 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 


Bravo 

Charlie 

Alfa 

Hotel 

Foxtrot 

Delta 

Echo 

Golf 

Kilo 

India 

Juliette 

Lina 


8) 

(i) 

(8) 

(6) 

(4) 

(5) 
(7) 
(ID 

(9) 

(10) 
(12) 


Figure  3.  (continued) 
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the  same  manner  that  the  speedometer,  odometer,  and  gas  gauge  provide 
related  information  about  a  cross-country  automobile  trip.  The  indices  were 
referred  to  during  the  interactive  group  process  to  determine  which  actions 
should  be  taken  during  the  meeting. 

The  goodness-of-f it  index  is  the  multiple  correlation  coefficient 
associated  with  an  equation  which  simultaneously  models  all  items  and  all 
judges  in  terms  of  their  separate  contributions  to  the  variance  of  the 
matrix  of  decisions  rendered  by  the  board.  As  shown  in  Figure  3  the 
individual  items  may  then  be  plotted  in  terms  of  their  level  of  priority 
(average  rank  mean)  and  in  terms  of  the  amount  of  disagreement  associated 
with  each  item.  The  percent  of  disagreement  is  ca^ulated  by  dividing  each 
item's  sum  of  squared  residuals  from  the  group  equation  by  the  total  sum  of 
squared  residuals  (TSSR)  associated  with  the  group  equation.  The  square  of 
the  goodness-of-f it  (R2)  index  measures  the  proportion  of  variance 
accounted  for  by  the  equation  and  is  directly  related  to  the  TSSR  by: 

TSSR 

R2  =  1.0  -  _  - .  [2] 

n 


where  TSSR  is  the  error  sum  of  squares  of  prediction  and  n  *0*2  is  the 
total  sum  of  squares  for  the  decision  matrix. 

The  statistical  indices  and  the  average  item  plots  provide  information 
and  suggestions  about  how  to  proceed  in  the  interactive  group  mode  for 
rendering  revised  group  judgments  (J2).  As  shown  in  the  example  (Fig.  3), 
items  f  and  g  were  more  disputed  than  items  b  or  j.  The  J1  results  reflect 
the  decisions  from  the  nominal  group.  Members  were  a  group  in  name  only 
since  they  did  not  confer  with  one  another  in  making  their  judgments.  Whan 
the  board  was  reconvened  at  J2,  they  examined  the  J1  results  to  identify 
those  items  upon  which  they  already  agreed  upon  in  terms  of  importance. 
(See  Fig.  2.)  The  advantage  of  this  procedure  was  that  time  could  then  be 
devoted  to  those  items  which  were  in  disagreement  and  merited  discussion. 

Since  board  members  were  experts,  there  were  no  right  or  wrong  answers; 
however,  the  expert  opinions  when  arrayed  collectively  indicated  majority 
and  minority  positions.  The  02  interacive  group  was  used  for  information 
exchange  and  revised  independent  judgments  to  arrive  at  a  group  judgment. 
Ore  hundred  percent  consensus  was  not  required;  however,  the  goodness-of-fit 
and  reliability  estimates  did  increase  as  agreement  among  expert  members 
increase*-. 

The  technology  of  the  IOM  process  produces  a  rank  ordered  list  of 
medical  combat  deficiencies  based  upon  the  merger  of  the  expert  opinions  of 
the  board  members  and  the  content  of  the  mission  area  analysis  fact  sheets. 
(The  reference  list  shown  in  Fig  3  contained  MAA  deficiency  descriptions.) 
The  medical  combat  deficiency  lists  used  in  this  study  are  at  Appendices  I 
through  III.  Examples  of  MAA  corrective  actions  are  contained  in  Appendix 
IV. 
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Procedural  effectiveness.  When  the  02  session  was  over,  experts  filled 
out  questionnaires  containing  biographical  and  experience  items  and  a  series 
of  questions  designed  to  measure  the  members'  perceptions  of  the  prioritized 
deficiency  lists.  These  questions,  with  7-pont  response  scales  anchored  at 
each  point,  were  employed  to  assess  the  effectiveness  of  the  J1-J2 
procedure.  Experts  were  asked  to  rate  their  individual  and  revised  group 
judgments  along  each  of  the  four  dimensions  of  confidence,  accuracy,  felt 
utilization  of  expertise,  and  overall  satisfaction.  According  to  small 
group  productivity  sources  cited  earlier,  it  was  hypothesized  that  experts 
would  perceive  the  revised  group  outcomes  (J2)  more  favorably  than  the 
independently  judged  outcomes  from  Jl.  A  sample  background  and  perception 
assessment  questionnaire  is  included  in  Appendix  V. 


RESULTS 


The  overall  results  of  this  research  indicated  that  experts  ranked 
medical  combat  deficiencies  in  a  similar  fashion,  that  they  felt  comfortable 
with  the  results,  and  that  both  the  subarea  and  major  deficiencies  which 
resulted  were  prioritized  in  an  appropriate  order  of  importance. 

Scope  of  Decisions 

In  human  judgment  research  there  is  often  a  trade-off  between  gathering 
a  few  measures  on  many  participants  and  gathering  many  measures  on  a  few 
participants.  Since  expert  panels  consisted  of  only  seven  persons  each,  the 
use  of  multiple  rank  order  decision  measures  became  a  necessity.  Each  of 
the  seven  FIC  members  rendered  rank  order  decisions  on  each  of  68  deficiency 
items,  which  resulted  in  a  total  of  476  independent  decisions.  Placement  of 
all  items  was  reviewed  in  the  J2  condition  which  doubled  the  number  of 
observed  decisions  from  FIC  experts  to  952.  Subsequently,  two  items  were 
deleted  from  the  deficiency  lists  during  the  J2  interactive  group 
discussion.  The  AMEDD  General  Officer  Board  deliberated  upon  each  of  the 
remaining  66  items  producing  462  independent  decisions  and  462  group 
decisions,  or  a  total  of  924  item  decisions.  The  seven  AMEDD  experts  also 
rank  ordered  each  of  the  major  13  deficiency  lists  independently  (91 
decisions)  and  in  the  group  mode  which  resulted  in  2  x  91  =  182  decisions. 
In  addition,  eight  procedural  effectiveness  variables  were  rated  by  all  14 
experts  for  a  total  of  112  perception  measures.  In  all,  this  research 
considered  some  2,170  ranking  decisions  over  a  period  of  two  days. 
Considering  that  14  experts  spent  about  a  day  for  the  J1-J2  sessions,  the 
prioritization  process  amounts  to  112  decision  manhours. 

Composition  of  Expert  Panels 

Table  1  presents  the  pertinent  background  and  experience  characteristics 
of  the  expert  committee  and  board  members  used  in  the  study.  With  regard  to 
the  FIC,  six  of  the  seven  experts  held  the  rank  of  colonel  (0-6)  and  one 
member  held  the  rank  of  lieutenant  colonel  (0-5).  All  committee  members 
were  male  and  represented  organizations  within  the  Academy  of  Health 
Sciences  and  included  the  Oeputy  and  Assistant  Commandants,  the  Directors  of 
Training,  Training  Development,  Support,  Medical  equipment  Test  and 
Evaluation,  and  Chief  of  the  Training  Evaluation  Division  (now  the 
Directorate  of  Evaluation).  All  FIC  experts  belonged  to  the  Army  Medical 
Service  Corps,  and  specialties  varied  from  67A  (Health  Care  Administration), 
67F  (Health  Services  Personnel  Manager),  67K  (Health  Services  Materiel 
Officer),  to  four  personnel  in  67H  (Health  Services  Plan,  Operations, 
Intelligence,  and  Officer  Training). 

The  average  age  of  committee  members  was  48.29  years,  with  an  average  of 
18.71  years  of  formal  education.  Altogether  the  committee  had  served  a 
total  of  174  years  in  the  military  (mean  =  24.86)  with  166  years  or  95.40% 
served  in  A.-1EDD  units  (mean  =  23.71  years).  Individuals  had  spent  an 
average  of  approximately  17  years  in  their  current  specialty,  with  some  five 
years  previously  spent  in  other  medical  corps  specialties.  Table  of 
Distribution  and  Allowances  (TDA,  e.g.,  fixed  hospital  facilities) 
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Table  1 


Composition  of  the  AHS  Force  Integration  Commitee 
and  the  AMEDO  General  Officer  Board  Employed  in 
Ranking  Mission  Area  Analysis  Deficiencies 


Background 

AHS  Force  Integration 
Committee 

Officer 

Variable 

Mean 

Std  Dev 

Mean 

Std  Dev 

Biographical  Characteristics 

Age  in  years 

48.29 

4.89 

50.71 

2.25 

Education  in  years 

18.71 

1.39 

21.71 

2.71 

Military  Experience  in  Years 

AMEDD  unit  assignments 

23.71 

5.26 

22.29 

2.60 

Current  job  (67A,F,H,K) 

17.29 

5.72 

— 

— 

Previous  job  (67B,J,K) 

5.57 

5.97 

— 

— 

TDA  assignments 

16.71 

3.88 

20.00 

3.25 

TOE  assignments 

8.00 

3.42 

3.43 

3.02 

Totai  Active  Military  Duty 

in  years 

24.86 

5.00 

23.43 

2.97 

Months  Served  in  Combat  Zones 

12.71 

6.82 

5.57 

6.50 

NOTE:  Both  groups  consisted  of  n=7  experts. 


assignments  accounted  for  117  years  of  service  compared  with  56  years  of 
collective  experience  in  Table  of  Organization  and  Equipment  (TOE,  e.g., 
field  type  units)  assignments.  All  but  one  committee  member  had  at  least  12 
months  of  combat  experience  in  either  Korea  or  the  Republic  of  Vietnam. 

The  composition  of  the  seven  member  AMEDD  General  Officer  Board  was  as 
follows:  one  officer  in  the  grade  of  major  general,  four  brigadier 
generals,  and  two  senior  level  colonels.  All  experts  were  male,  and  were 
assigned  to  either  the  Medical,  Oental,  or  Veterinary  Corps  of  the  Army 
Medical  Department  (AMEDD).  Organizations  represented  by  the  board 
consisted  of  the  Office  of  The  Surgeon  General  (OTSG),  US  Army  Health 
Services  Command  (HSC),  7th  Medical  Command  (MEDCOM),  the  Academy  of  Health 
Sciences  (AHS),  and  the  US  Army  Medical  Research  and  Development  Command 
(USAMRDC). 

The  average  aqe  of  the  board  members  was  50.71  years,  with  an  average  of 
21.71  years  of  education  including  physician  and  dental  specializations. 
Collectively  the  board  had  164  years  of  active  duty  Army  experience  (mean  * 
23.43  years)  of  which  156  or  95.12%  had  been  spent  in  AMEDD  units.  Of  the 
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164  years  of  active  duty,  140  years  (85.374)  were  served  in  TDA  assignments 
and  24  years  (14.634)  were  served  in  TOE  assignments.  In  addition,  three 
members  indicated  that  they  had  served  a  total  of  39  months  in  combat  zones 
including  the  Republic  of  Vietnam  and  Lebanon,  resulting  in  an  overall 
average  of  5.57  months  of  combat  experience  for  the  board. 

The  fact  that  the  overall  time  spent  in  TDA  assignments  for  both 
committee  and  board  members  outweighs  TOE  assignments  by  better  than  three 
to  one  is  worthy  of  comment.  This  finding  is  not  unusual  considering  the 
nature  of  the  AMEDO  mission  which  is  to  provide  medical  care  in  peacetime  as 
well  as  wartime.  Since  the  experts  were  physicians,  dentists,  and  health 
care/services  managers,  most  of  their  personnel  assignments  would  be  in 
hospital  and  medical  training  (TOA)  units. 

In  summary,  the  combined  military  experience  resources  of  both  groups  of 
experts  represented  some  338  years  of  active  Army  duty  with  322  years 
reflecting  medic'il  assignments,  cutting  across  80  years  of  TOE  and  257  years 
of  TDA  assignments  and  details.  Further,  the  time  accounted  for  in  combat 
environments  for  all  14  experts  totaled  128  months  or  a  tota1  of  10.67  years. 

In  light  of  the  wealth  of  military  medical  experience  and  expertise 
represented  by  the  members  of  the  committee  and  board  described  above,  the 
results  of  this  study  constitute  a  defensible  and  comprehensive  basis  for 
determining  the  rank  order  of  medical  combat  deficiencies. 

Procedural  Effectiveness  Measures 


Four  measures  of  the  efficacy  of  the  J1-J2  sequence  were  obtained  from 
7-point  icting  scales  which  assessed  the  experts'  perceptions  of  confidence, 
accuracy,  felt  utilization  of  expertise,  and  overall  satisfaction  with 
reqard  to  the  item  ranking  decisions. 

Table  2  presents  the  means  and  standard  deviations  of  the  procedural 
effectiveness  measures  for  both  the  AHS  and  AMEDD  expert  groups.  As 
indicated  in  the  table  and  the  accompanying  figure  (see  Figure  4),  gross 
perception  ratings  for  all  dimensions  combined  generally  increased  from  the 
independent  to  the  revised  group  judgment  condition  with  _t ( 27)  =  2.67, 
p<-05,  for  committee  perceptions,  and  t(27)  =  4.26,  £<.001,  for  general 
officer  perceptions.  This  finding  indicated  that  overall,  experts  felt  more 
comfortable  with  their  revised  group  judgments  than  with  their  initial 
independent  decisions.  Also,  all  ratings  were  well  above  the  neutral 
position  (4.0)  on  the  7-point  rating  scale  indicating  that  all  perceptions 
were  regarded  as  positive. 

Two  2  x  4  analyses  of  variance  with  repeated  measures  were  used  to 
determine  the  specific  variations  in  perceptions  attributable  to  independent 
versus  revised  group  judgments  (01  versus  J2)  and  the  four  assessment 
dimensions  (Table  3).  In  reference  to  the  FIC  group,  the  main  effect  for 
perceptions  was  significant,  F  (3,18)=  10.05,  p<.001.  FIC  experts 

reported  that  they  were  satisfied  and  confident  more  often  with  both 
independent  and  group  ranks,  but  that  they  felt  less  positive  about  the 
utilization  of  their  expertise.  This  finding  can  be  attributed  to  the  fact 
that  two  experts  reported  they  did  not  receive  the  read-ehead  package  until 
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Table  2 


Perceptions  of  Independent  Versus  Revised  Group 
Rank  Judgments  of  Combat  Medical  Deficiencies 


Assessment 

Independent  Judgements 

Revised  Group  Judgments 

Dimension 

Mean 

Std  Dev 

Mean 

Std  Dev 

AHS  Force 

Integration 

Commitee 

Confidence 

5.86 

.83 

6.14 

.64 

Accuracy 

5.71 

.45 

5.86 

.35 

Felt  utilization  of  expertise 

4.86 

.99 

5.57 

.49 

Overall  satisfaction 

5.86 

.64 

6.29 

.70 

All  dimensions  combined 

5.57 

.86 

5.96 

.63 

AMEDO  General  Officer 

Board 

Confidence 

5.57 

.49 

6.14 

.35 

Accuracy 

5.57 

.49 

6.29 

.70 

Felt  utilization  of  expertise 

5.86 

.64 

6.00 

.53 

Overall  satisfaction 

6.00 

.76 

6.43 

.49 

All  dimensions  combined 

5.75 

.63 

6.21 

.56 

N0T£ :  Perceptions  were  assessed  on  7-point  rating  scales  with  higher  values 
indicating  a  greater  amount  of  the  dimension  being  measured. 


the  day  the  committee  met,  so  they  felt  less  prepared  than  other  members. 
However,  in  reference  to  each  of  the  separate  assessment  dimensions,  members 
saw  little  difference  among  their  independent  and  group  judgments.  These 
findings  indicated  that  the  FIC  experts  did  not  perceive  the  need  for 
substantive  group  revisions  of  their  initial  independent  decisions. 

Results  from  the  General  Officer  Board  differed  markedly  from  the  FIC 
member  perceptions.  The  main  effect  for  J1  -  J2  decisions  was  pronounced 
with  £(1,6)  =  11.27,  p<.05.  This  finding  indicated  that  the  officers  of 
the  second  board  felt  that  their  revised  group  rank  orders  of  combat 
deficiencies  were  more  accurate,  utilized  their  expertise  to  a  greater 
degree,  and  that  they  felt  confident  and  satisfied  with  the  revisions  made 
by  the  group. 

In  addition,  the  absence  of  interaction  effects  in  both  analyses 
indicated  that  the  J1  -  J2  procedure  was  not  differentially  effective  across 
assessment  dimensions,  and  that  any  changes  in  perceptions  were  invariably 
in  an  upward  direction. 

Shifts  in  specific  procedural  effectiveness  measures.  While  trends  in 
perceptions  exhibited  upward  changes,  changes  were  not  always  equal  in 
magnitude.  For  the  confidence  dimension,  an  initial  average  rating  of 
5.86--between  somewhat  (scale  value  =  5)  and  very  (scale  value  =  6) 

conf ident--was  recorded  for  the  FIC  independent  combat  deficiency  rankings. 
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Table  3 


Analysis  of  Variance  Summaries  for  Expert  Panel  Perceptions 


Source 

SS 

df 

MS 

F 

Force  Integration 

Committee 

Within  subjects 

10.36 

6 

- 

- 

J1  vs  02  (J102) 

2.16 

l 

2.16 

2.09  n/s 

Perceptions  (Prcn) 

6.34 

3 

2.11 

10.05** 

J1J2  x  Prcn 

.63 

3 

.21 

.83  n/s 

Residuals 

J1J2 

6.21 

6 

1.04 

Prcn 

3.79 

18 

.21 

01J2  x  Prcn 

4.50 

18 

.25 

Total 

IT 

AMEDD  General  Officer  Board 

Within  subjects 

11.61 

6 

- 

- 

J1  vs  02  (0102) 

3.02 

1 

3.02 

11.27* 

Perceptions  (Prcn) 

1.05 

3 

.35 

2.24  n/s 

0102  x  Prcn 

.63 

3 

.21 

1.67  n/s 

Residuals 

0102 

1.61 

6 

.27 

Prcn 

2.82 

18 

.16 

0102  x  Prcn 

2.25 

18 

.12 

Total 

TTM 

5T 

MOTf:  **  £<.6ol,  *£<,65,  n/s  *  nonsignificant 


Subsequently,  FIC  experts  reported  an  Increase  in  their  confidence  rating  of 
.28  resulting  In  an  average  of  6.14  (very  confident)  for  the  revised  group 
ranks  of  the  same  deficiences.  For  the  General  Officer  Board,  the  average 
confidence  ratings  Increased  by  .57  of  a  scale  point  from  5.57  (between 
somewhat  and  very  confident)  to  6.14  (very  confident). 

The  average  accuracy  ratings  of  FIC  experts  shifted  from  5.71— between 
somewhat  (5)  and  very  (6)  accurate— to  an  average  of  5.86,  slightly  closer 
to  very  accurate.  However,  average  accuracy  ratings  from  general  officers 
increa.-'d  by  .72  scale  points  from  5.57  (between  somewhat  and  very  accurate) 
to  6.29— between  very  (6)  and  extremely  (7)  accurate. 

The  J1  -  02  average  rating  shift  for  FIC  felt  utilization  of  expertise 
was  dramatic  also.  The  initial  independent  average  rating  of  4.86  fell 
between  quite  (4)  well  and  very  (5)  well.  The  mean  rating  for  the  revised 
qroup  decision  exhibited  an  increase  of  .71  scale  points  to  5.57  (between 
very  well  and  excellently).  General  officer  ratings  of  felt  utilization 
increased  from  5.86  to  6.00. 

Finally,  the  highest  averages  among  all  perceptions  were  displayed  by 
the  satisfaction  dimension  for  both  groups.  For  FIC  experts,  the  J1 
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satisfaction  average  increased  by  .43  from  5.86  (between  somewhat  and  very 
satisfied)  to  6.29  (between  very  and  extremely  satisfied)  for  the  J2 
condition.  Likewise,  an  increase  of  .43  from  6.00  (very  satisfied)  to  6.43 
(between  very  and  extremely  satisfied)  was  observed  for  the  General  Officer 
Board. 

In  summary,  the  J1-J2  exercise  appeared  to  be  meaningful  and  useful  for 
both  groups  of  experts  and  tended  to  enhance  their  perceptions  of  the  rank 
order  priorities  of  MAA  medical  combat  deficiencies. 

Force  Integration  Committee  (FIC)  -  Independent  Judgments  (J1)  of  Medical 
Combat  Subarea  Priorities 


Table  4  presents  a  summary  of  the  independent  judgments  rendered  by  the 
FIC.  Results  were  associated  with  68  deficiencies  within  13  major  lists 
(see  column  1).  Letters  identify  each  subarea  item  (column  2)  and  are  rank 
ordered  from  most  to  least  important  by  the  average  of  the  item  ranks 
assigned  by  the  seven  experts.  The  last  three  columns  of  the  table  display 
the  three  summary  statistics  used  1)  to  determine  the  degree  of  predictive 
goodness-to-fit  for  the  13  separate  group  regression  equations  (multiple 
correlation  coefficient  R ) ,  2)  to  assess  the  levels  of  internal  consistency 
among  experts  (rho  =  coefficients  of  inter-rater  reliability),  and  3)  to 
test  hypotheses  of  significant  differences  among  item  rank  means  within  each 
list  (£  ratios  with  associated  degrees  of  freedom). 

The  multiple  R  is  a  measure  of  the  goodness-of-f it  for  a  given  group 
prediction  equation  which  simultaneously  expresses  the  decisions  for  a  list 
as  a  function  of  both  items  and  experts.  A  maximum  value  of  1.0  for  R 
indicated  perfect  predictability  of  the  experts'  decisions  in  regard  to  the 
rank  order  of  items  (e.g. ,  list  8  -  Preventive  Medicine).  Values  from  about 
.60  to  .80  indicated  fair  to  good  prediction  (lists  1,  3,  7,  9,  and  11),  and 
values  of  .80  to  above  (lists  2,  4,  12,  and  13)  indicated  good  to  excellent 
results  for  group  equations.  Multiple  R  results  of  less  than  .60  (lists  5, 
Optometry/Optical ;  6,  Dental;  and  10,  Clinical  Lab/Blood  Ban’.)  represented 
weak  predictions  of  independent  judgments  and  may  be  interpreted  as  a  signal 
which  indicated  that  group  discussion  J2  was  probably  required  on  those 
particular  lists. 

The  inter-rater  reliability  coefficients  measured  the  internal 
consistency  among  the  experts'  ranks  and  can  be  interpreted  as  follows.  A 
given  list  of  items  has  a  set  of  average  ranks  assigned  to  it  by  the  seven 
experts.  If  the  same  list  of  items  were  to  be  ranked  by  another  comparable 
set  of  seven  experts,  then  the  expected  correlation  between  the  two  sets  of 
item  rank  means  would  result  in  the  value  indicated  by  rh077. 
Reliabilities  of  .80  and  above  represented  acceptable  levels  of  inter-rater 
agreement,  and  1.0  indicated  perfect  agreement  (e.g.,  list  8). 
Reliabilities  below  .80  indicated  disagreements  among  the  experts  and  again 
lists  5,  6,  and  10  were  identified  as  requiring  group  discussion. 

Finally,  the  F  ratios  were  used  to  test  the  hypotheses  that  item  rank 
means  within  lists  were  statistically  different  from  one  another.  High  F 
ratios  indicated  that  experts  could  discriminate  among  items  in  terms  of 
importance,  and  that  not  all  items  were  judged  to  be  of  similar  or  equal 
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Table  A 

ry  Results  for  Mission  Area  Analysis  of  Medical  Combat  Deficiencies 
Rank  Data  From  AHS  Force  Integration  Committee 

J1  Independent  Judgments 
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List  2.  Force  Structure  reworded  to  Items  Moved  Between  Lists _ 

Medical  Resources  From  List  3.  to  List  1.  -  Monitor  vital  signs  in  MOPP  deficiencies 

From  List  2.  to  List  3.  -  Power/illumination  deficiencies 


importance.  The  probability  associated  with  an  F  indicated  the  odds  that 
each  F.  could  have  occurred  by  chance.  For  instance,  if  list  1  —  Medical 
Treatment  --  were  rank  ordered  1,000  times  we  would  expect  a  value  of  10.48 
or  greater  to  occur  only  once  by  chance  alone.  All  lists  achieved 
significance  with  the  exception  of  the  same  three  lists  identified  above. 
As  shown,  lists  5,  Optometry;  6,  Oental;  and  10,  Clinical  Lab/Blood  Bank 
failed  to  exhibit  statistically  significant  differences  among  the  item  means. 

Overall,  58  out  of  the  68  subarea  items  were  ranked  in  an  acceptable 
order  based  on  the  interpretation  of  the  statistical  analyses.  Only  10  of 
the  68  items  (14.71%)  contained  in  three  lists  indicated  that  interactive 
group  discussion  was  required  to  identify  the  rationale  that  experts  had 
used  in  making  their  judgments. 

Figure  5  displays  the  separate  graphic  analyses  conducted  for  each  major 
discrepancy  list.  As  shown  by  the  standard  graphic  display  for  Medical 
Treatment,  subarea  item  means  were  plotted  vertically  by  priority  and 
horizontally  by  the  amount  of  disagreement  associated  with  each  item.  The 
percent  of  disagreement  for  each  item  was  computed  as  the  proportional 
lack-of-fit  obtained  from  the  squared  residual  scores  of  the  group 
prediction  equation.  Each  graph  also  contains  a  baseline  (dashed  vertical 
line)  which  indicates  a  hypothetical  equal  amount  of  disagreement  per  item. 
For  list  1,  if  all  items  had  an  equal  amount  of  disagreement  then  the 

baseline  was  computed  as  100%  divided  by  8  items  or  12.50%.  Items  plotted 
to  the  left  of  the  baseline  exhibited  less  than  the  average  error  of 

prediction  (disagreement),  and  those  to  the  right  demonstrated  more  than  an 
equal  share  of  lack-of-fit.  For  Medical  Treatment,  item  e  (Self/buddy  aid) 
showed  little  expert  disagreement  that  it  should  be  placed  at  the  top  of  the 
list  (mean  =  1.43,  percent  disagreement  =  3.19%).  Likewise,  there  was 
little  disagreement  that  items  a  (Laser/microwave  injury)  and  h 
(Maxillofacial  injury)  were  of  less  importance  than  other  items  on  the 
list.  Specific  results  for  the  remaining  FIC  judgments  follow. 

Leading  Medical  Force  Structure  deficiencies  consisted  of  COMMZ  hospital 
items  (a  and  d)  and  Field  treatment  of  combat  stress  (k).  As  shown,  the 
multiple  correlation  (.81)  and  reliability  (.91)  associated  with  these  judg¬ 
ments  were  hiqh,  and  items  were  well  distributed  throughout  the  range  of 

priorities  indicated  by  the  statistical  significance  of  the  F_  ratio. 

Medical  Logistics  deficiency  judgments  resulted  in  a  moderate  level  of 
prediction  and  an  adequate  amount  of  inter-rater  reliability.  Several 

trends  emerge  with  regard  to  logistics  items. 

First,  the  list  contained  one  3-way  tie  (items  concerning  h. 
Refrigeration;  d.  Monitor  vital  signs  in  MOPP  gear;  and  c,  Eye  protection) 
and  one  2-way  tie  (items  m.  Covered  storage,  and  i.  Material  handling 

equipment).  Ties  do  not  present  problems  when  squared  residual  analyses  are 

used.  The  per  item  contributions  to  the  total  group  prediction  equation's 

sum  of  squared  residuals  (percent  of  disagreement)  are  different  for  each 

tied  item  so  tied  ranks  do  not  require  special  adjustments  (cf.  Guilford  & 
Fruchter,  1973,  pg.  284)  and  can  be  ordered  by  listing  items  with  the 
smallest  amount  of  disagreement  first. 
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1.  MEDICAL  TREATMENT  DEFICIENCIES 
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X  Item _ Description _ 

1.57  a  COMMZ  hospital  assets 
3.00  k  Field  treat  combat  stress 

3.71  d  COMMZ  hospital  augments tior 
4.00  c  Power /illumination 

5.57  g  M0S/SSI  identifiers 

7.00  j  Clinical  lab  requirements 
7.29  b  Civ  structure  conversion 
8.00  1  Field  kitchen 

8.43  f  Optometry  team  support 
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9.43  h  Medical  food  support 
11.29  i  Dental  at  general  hospital 
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Figure  5.  Academy  of  Health  Sciences  Force  Integration  Committee 
independent  judgment  (Jl)  results  for  subarea  medical  combat 
deficiency  priorities.  ,0 
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3.  MEDICAL  LOGISTICS  DEFICIENCIES 


^77  « 

F(12 ,78)  -  6.11,  £<.001 

X  Item _ Description _ 

1.86  k  Med  unit  mobility  wgt/cube 

2.71  f  Medical  resupply 
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6.00  c  Eye  protection  (frag  radn) 
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Second,  the  experts'  raw  ranking  profiles  for  Medical  unit  mobility 
(item  k)  and  Medical  resupply  (item  f)  were  3221122  and  1512271 
respectively.  While  item  f  was  ranked  first  by  three  experts  and  item  k 
received  only  two  first  place  ranks,  the  average  for  f  (2.71)  falls  below 
that  of  k  (1.86).  This  findinq  is  an  example  of  the  “frequent  second-choice 
wins"  phenomenon.  The  item  average  is  calculated  as  the  preuicted  item 
score  produced  by  the  group  prediction  equation.  Since  the  equation 
considers  aj_l_  items  and  ajn_  experts,  extreme  values  directly  influence  each 
item  average.  As  shown  on  the  graph,  item  k  has  less  disagreement  than  item 
f  because  the  item  k  raw  ranks  were  less  variable,  i.e.,  contained  ranks  of 
first,  second,  and  third  place  only. 

Other  decision  measurement  techniques,  such  as  the  method  of  paired 
comparisons,  are  also  affected  by  the  "frequent  second-choice  wins" 
phenomenon.  For  instance,  if  experts  had  each  contributed  their  own  item  to 
a  list,  more  likely  than  not  each  expert  would  rank  his  or  her  item  as 
number  one  on  his  or  her  list.  Because  experts  would  disagree  so  strongly 
about  the  top  priority,  the  item  chosen  second  by  most  of  the  experts  could 
result  in  the  smallest  item  rank  average  and  would  likely  result  as  the  top 
priority  item  for  the  entire  list. 

For  list  4,  Patient  Evacuation  and  Regulating,  all  experts  unanimously 
ranked  field  medical  records  (item  b)  third  on  the  list  as  reflected  by  zero 
disagreement.  Air  ground  evacuation  and  Ground  ambulance  items  were  ranked 
first  and  second.  Goodness-of-f i t  and  internal  consistency  were  acceptable 
for  the  item  order  displayed. 

Optometry/Optical  Service  deficiencies  consisted  of  two  items.  Three 
experts  ranked  item  a  (Visual  correction  and  protection)  first,  while  four 
members  assigned  item  b  (Optometry  personnel  equipment  operation)  as  the 
first  priority.  List  5  was  identified  as  one  of  the  topics  for  group 
discussion  because  of  the  narrow  difference  between  item  means  (a=1 .57 
versus  b=l .43) . 

Dental  Service  deficiencies  were  also  identified  for  group  discussion 
because  of  the  low  goodness-of-f it  (.49)  and  reliability  (.49)  indices.  As 
shown  in  Figure  5,  the  averages  for  items  pertaining  to  the  dental  health  of 
individual  soldiers  (b)  and  performance  of  dental  personnel  in  battle  (a) 
were  tied;  however,  item  b  exhibited  somewhat  less  disagreement  than  item  a 
(32.43%  versus  51.35%). 

Like  the  Optometry/Optical  list.  Veterinary  Services  also  contained  two 
items.  Unlike  the  former  list,  the  item  means  demonstrated  a  definitive  and 
acceptable  separation  which  was  reflected  by  the  results  for  R=.71, 
rho77= .84 ,  and  the  statistically  significant  F  ratio. 

Preventive  Medicine  items  b  (Early  warning)  and  a  (Medical  unit 
organization)  were  ranked  identically  by  all  experts;  this  resulted  in  zero 
disagreement  and  maximal  prediction  and  reliability.  The  £_  ratio  is  not 
applicable  to  such  a  situation  since  prediction  errors  cannot  be  estimated 
for  perfect  agreement. 
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Judgments  of  Medical  Command,  Control,  and  Communication  deficiencies 
resulted  In  a  moderate  goodness-of-f it  (.75)  and  a  fairly  good  level  of 
reliability  (.87).  Tied  rank  averages  for  item  d  (Medical  regulating  in 
battle)  and  b  (Systems)  were  separated  by  6.48  percentage  points  of 
disagreement  (22.22  versus  28.70%)  which  placed  the  Medical  regulating  item 
as  the  top  priority  on  the  list. 

Judgments  of  list  10,  Clinical  lab  and  blood  bank  services,  indicated 
that  some  experts  ranked  items  in  the  opposite  direction  from  other 
experts.  As  a  result  the  item  averages  tended  to  cluster  to  the  middle  of 
the  priority  dimension.  Although  items  could  be  rank  ordered  based  upon  the 
minor  differences  among  means,  the  attenuated  levels  associated  with  the 
summary  statistics  indicated  that  these  items  merited  group  discussion  and 
revision. 

Chemical  warfare  results  aligned  items  in  a  fairly  clear  order  ranging 
from  Chemical  prophylaxis  measures  (f)  down  to  Medical  materiel  packaging 
deficiencies  (g).  Prediction  (.74)  and  reliability  (.86)  results  were 
acceptable  as  was  the  significance  test  for  item  mean  differences. 

The  last  two  lists  concerned  Nuclear  and  Biological  Warfare  and 
contained  the  same  three  items.  Experts  ranked  both  lists  in  a  similar 
fashion,  and  unanimously  placed  Medical  materiel  packaging  (c)  as  the  bottom 
priority  on  each  list.  While  Detection  (a)  and  Prophylaxis  (b)  items  were 
close  in  importance,  the  reliability  measures  (.95)  indicated  that  the 
judgments  were  stable  and  acceptable. 

FIC  -  Revised  Group  Judgments  (J2)  of  Medical  Combat  Subarea  Priorities 

After  the  experts  had  reviewed  the  results  of  the  independent  judgments, 
each  of  the  three  disputed  lists  were  discussed.  As  a  result,  lists  for 
Optometry/Optical,  Dental,  and  Clinical  Laboratory/Blood  Bank  Service 
deficiencies  were  reordered  as  shown  at  the  bottom  of  Table  4.  Interactive 
group  discussio..  was  not  limited  to  reprioritization  of  items  within  lists. 
Through  further  discussion,  members  decided  to  rename  list  2  from  Force 
Structure  to  Medical  Resources.  In  addition,  by  unanimous  vote,  two  of  the 
68  items  were  deleted,  and  two  others  were  moved  from  one  list  to  another. 
A  few  minor  wording  chanqes  also  were  made  to  some  item  descriptions  for 
purposes  of  clarification  (compare  Appendices  I  and  II).  The  revised  group 
judgments  (J2)  were  recorded  and  served  as  the  stimulus  input  items  for  the 
independent  round  of  judgments  (Jl)  made  by  the  AMEDD  General  Officer  board 
that  was  held  a  few  weeks  later.  It  is  Interesting  to  note  that  these 
chanqes  would  not  have  emerged  if  analyses  had  been  limited  to  nominal  group 
decisions. 

AMEDO  General  Officer  Board  -  Independent  Judgments  (Jl)  of  Medical 
Combat  Subarea  Priorities 


Table  5  presents  a  summary  of  the  Independent  judgments  rendered  by  the 
AMEDD  General  Officer  Board.  Globally,  rank  orders  of  the  66  items  appeared 
to  be  similar  to  the  orders  obtained  from  comnittee  members  (Table  4). 
Within  the  good  to  excellent  range  of  prediction,  two  AMEDD  lists  fell  at 
R*.80  and  above— lists  (4)  Evacuation  and  Regulating  and  (12)  Nuclear 
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Note :  Underlined  items  indicate  adjacent  tied  item  rank  averages.  Ties  w 

least  disagreement  (smallest  proportion  of  squared  residual)  first. 
an/s  =  non-significant,  ***  £<.001,  **£<.01,  *£<.05 


environment.  Fair  to  good  prediction  results  (R-.60  to  .80)  Mere  associated 
with  six  lists:  (1)  Medical  Treatment,  (2)  Medical  Resources  (formerly 
Force  Structure),  (5)  Optometry/Optical,  (9)  Medical  Command,  Control,  and 
Comnunicatlon,  (11)  Chemical  Warfare,  and  (13)  Biological  Warfare.  Compared 
with  the  results  from  the  FIC  experts  (Table  4)  and  the  above  AMEDO 
lists--with  the  exception  of  list  5--all  lists  fell  within  the  range  of  fair 
to  excellent  prediction  for  both  panels.  Prediction  results  falling  below 
.60  for  AMEDO  experts  included  the  remaining  five  lists:.  (3)  Medical 
Logistics,  (6)  Dental,  (7)  Veterinary,  (8)  Preventive  Medicine,  and  (10) 
Clinical  lab/81ood  Bank.  These  findings  indicated  that  five  areas  of 
disagreement  existed  among  AMEDO  experts  that  required  interactive  revised 
group  actions. 

Acceptable  J1  reliabilities  (over  .80)  for  AMEDO  judgments  were  obtained 
for  all  lists  except  3,  6,  7,  8,  and  10.  Two  of  these  lists,  6  and  10,  had 
previously  been  disagreed  upon  by  FIC  members.  Significance  tests  further 
indicated  that  mean  ranks  among  lists  7,  8,  and  10  were  somewhat  unstable. 
One  very  striking  difference  between  the  panels  of  experts  was  observed  for 
list  8,  Preventive  Medicine.  Prediction  and  reliability  estimates  for  this 
list  were  extremely  high  for  the  committee  judgments  (1.0),  whereas  the 
AMEDD  judgment  prediction  (Fc_=« .14)  and  corresponding  reliability  (30.0)  were 
quite  low. 

In  summary,  the  level  of  prediction  appeared  to  be  slightly  higher  for 
the  first  panel  of  experts  (ranging  from  .70  to  1.0)  than  for  the  second 

panel  (ranging  from  .67  to  .89).  Likewise,  five  of  the  ten  acceptable 
reliability  estimates  for  the  first  panel  were  .91  or  better  as  opposed  to 
only  two  of  the  eight  acceptable  estimates  from  the  second  panel.  While 
prediction  and  reliability  findings  were  useful  for  both  panels  in  the 

identification  of  independent  judgment  areas  that  required  discussion,  the 
FIC  member  decisions  appeared  to  be  more  homogeneous  than  those  of  the  AMEDD 
board.  This  finding  may  be  interpreted  as  a  reflection  of  the  regular 
meetings  attended  by  the  FIC  experts  within  the  same  organization  (AHS)  or 
perhaps  of  the  higher  similarity  of  background  characteristics  of  the 
committee,  e.g.,  TOE  and  combat  experience  (Table  1). 

Figure  6  displays  the  separate  graphic  analyses  conducted  for  the  AMEDD 
General  Officer  Board  01  decisions.  The  standard  graphic  display  for 
Medical  treatment  shows  subarea  item  means  plotted  vertically  by  priority 
with  item  disagreement  plotted  on  the  horizontal  axis.  Of  the  nine  items 

(b).  Resuscitation,  and  (c).  Medical  and  surgical  treatment  of  injuries  in 

battle,  were  the  top  priorities  followed  by  (e).  Self  and  buddy  aid.  Item 
averages  for  (a).  Laser /microwave  injury,  and  (d).  Combat  stress,  were 
tied.  Item  (a)  was  ranked  fourth  and  (d)  fifth  based  upon  the  percent  of 
disagreement.  Goodness-of-flt  and  rel’ ability  were  adequate. 

Leading  Medical  Resource  deficiencies  consisted  of  COMMZ  hospital  items 
(a  and  c).  The  top  priority,  item  a,  was  ranked  number  one  by  all  but  one 
expert  who  ranked  it  second  to  item  c.  The  multiple  correlation  (.68)  and 
reliability  (.81)  associated  with  these  judgments  were  adequate,  although 
the  remaining  eight  items  in  the  lower  range  were  clustered  from  priorities 
5  to  8.  Overall,  however,  significant  differences  were  found  among  item 
rank  means. 
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Figure  6.  AMEDD  General  Officer  Board  independent  judgment  (Jl) 
results  for  subarea  medical  combat  deficiency  priorities. 
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Figure  6.  (continued) 
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Figure  6.  (continued) 
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Figure  6.  (continued) 
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Medical  Logistics  deficiency  judgments  (list  3)  resulted  in  an 
attenuated  level  of  prediction  (.57)  and  a  very  modest  level  of  reliability 
(.65).  Items  tended  to  cluster  between  the  third  and  tenth  priority 
positions  which  indicated  the  need  for  group  discussion  since  top  and  bottom 
priorities  were  not  clearly  defined. 

For  list  4,  Patient  evacuation  and  regulating,  all  experts  again 
unanimously  ranked  Field  Medical  records  (item  b)  third  on  the  list,  as 
reflected  by  zero  disagreement.  Consistent  with  the  FIC  rankings.  Air 
ground  evacuation  and  Ground  ambulance  items  were  ranked  first  and  second. 
Goodness-of-f it  and  internal  consistency  were  quite  high  for  the  item  order 
displayed. 

Optometry/Optical  service  deficiencies  consisted  of  two  items.  Unlike 
FIC  judgments,  however,  item  (a).  Visual  correction/protection  devices,  was 
clearly  separated  from  (b)  Optometry  personnel  equipment  operations. 
Multiple  correlation  (.71)  and  reliability  (.84)  coefficients  were  adequate, 
and  a  statistically  significant  difference  was  detected  between  item 
averages. 

Dental  service  deficiencies  were  also  indentified  for  group  discussion 
because  of  the  low  goodness-of-f it  (.57)  and  reliability  (.66)  indices.  Of 
the  three  items,  the  top  priority  item  b  (Dental  health  of  individual 
soldiers)  appeared  to  be  the  most  stable  since  it  exhibited  less 
disagreement  than  the  other  items. 

The  priority  placement  of  Veterinary  service  items  and  Preventive 
medicine  items  appeared  to  be  disputed.  Very  low  prediction  and  reliability 
levels  identified  these  two  lists  for  subsequent  group  discussion. 

Judgments  of  Medical  Command,  Control,  and  Communication  deficiencies 
resulted  in  a  fair  goodness-of-f it  (.68)  and  an  acceptable  level  of 
interater  agreement  (.81).  Item  (a)  PLRS/JTID  and  Systems  deficiencies  led 
item  (c)  Medical  regulating  in  battle  by  a  narrow  margin. 

Judgments  of  list  10,  Clinical  lab  and  blood  bank  services,  indicated 

that  some  experts  ranked  items  in  the  opposite  direction  from  other 
experts.  This  was  also  the  case  for  FIC  judgments.  As  a  result,  item 
averages  tended  to  cluster  between  2.14  and  3.57.  The  attenuated  levels 
associated  with  the  summary  statistics  indicated  that  these  item  judgments 
required  group  discussion  and  revision. 

Goodness-of-f it  for  list  11,  Chemical  Warfare  deficiencies,  was  adequate 
(.67)  although  reliability  was  marginal  (.79).  The  pattern  of  results 
clearly  aligned  item  (f)  Chemical  prophylaxis  as  the  top  priority,  while 
items  (c).  Protective  shelter  for  patients,  and  (g).  Medical  materiel 
packaging,  were  not  clearly  separated  as  items  of  lesser  importance. 

The  last  two  lists  concerned  Nuclear  and  Biological  warfare  and 
contained  the  same  three  items.  Prediction  and  reliability  results  were 
adequate,  and  item  (c).  Medical  materiel  packaging,  was  ranked  last  on  both 
lists.  Item  (b).  Prophylaxis,  was  clearly  the  first  prority  for  Nuclear 

deficiencies,  but  was  reversed  with  item  (a).  Detection  for  the  Biological 

warfare  list,  to  break  the  resultant  tie  (item  rank  means  =  1.57). 


Comparison  of  FIC  J1-J2  Item  Ranks  with  AMEDD  General  Officer  Board  J1 
Item  Ranks  " 


Although  levels  of  prediction,  reliability,  and  item  rank  mean 
differences  were  similar  among  both  groups  of  experts,  the  specific  rank 
orders  of  items  were  not  necessarily  the  same.  To  compare  specific  item 
ranks  across  groups,  a  series  of  Spearman  rank  difference  correlations  were 
computed  for  deficiency  lists.  Summary  results  are  presented  in  Table  6. 


Table  6 

Summary  of  Comparisons  of  J1-J2  FIC  Item  Ranks  With 
The  AMEDD  General  Officer  Board  J1  Item  Ranks 


Major  Deficiency  Area3 

Spearman  Rjnk 
Difference  Com. 

Number  of 
b  Matching  Items 

d.f 

Patient  Evacuation  &  Regulating 

'.00 

3 

1 

30ptometry/0ptical  Service 

1.00 

2 

- 

a0ental  Services 

1.00 

3 

1 

Veterinary  Services 

1.00 

2 

- 

Preventive  Medicine 

1.00 

2 

- 

Biological  Warfare  Environment 

1.00 

3 

2 

Medical  Resources  (Force  Structure) 

.99** 

10 

8 

Chemical  Warfare 

.79* 

7 

5 

Medical  Logistics 

.55* 

12 

10 

Medical  Command,  Control, 

&  Communication 

.80  n/s 

4 

2 

aCl inical  Laboratory/Blood  Bank 

.80  n/s 

5 

3 

Medical  Treatment 

.57  n/s 

8 

6 

Nuclear  Environment 

.50  n/s 

3 

Total  64 

1 

^Indicates  comparison  based  on  revised  group  judgment  (J2)  from  FIC  experts. 
btevel  of  statistical  significance,  **p<r.01,  *£<.05,  n/s  =  nonsignificant. 

Six  of  the  13  major  deficiency  lists  were  prioritized  identically  by 
both  expert  panels.  These  six  lists  encompassed  15  of  the  64  (23.44%) 
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possible  direct  subarea  comparisons.  An  additional  29  items  from  three 
other  lists  achieved  an  acceptable  level  of  statistical  significance.  This 
finding  indicated  that  both  boards  ranked  items  in  a  similar  fashion.  For 
the  remaining  20  items  the  level  of  similarity  appeared  attenuated 
(.50  -  .80),  but  in  a  positive  direction.  Only  one  major  deficiency  area, 
Optometry/Optical  Services,  was  ranked  in  reverse  order  by  the  two  boards 
during  the  J1  condition.  However,  the  order  for  Optometry/Optical  items  was 
revised  by  the  FIC  experts  during  the  J2  group  discussion.  The  absence  of 
any  negative  correlations  indicated  that  there  were  few  substantive 
differences  in  the  priority  of  items  obtained  from  the  two  groups  oi 
experts.  The  similarity  of  placement  for  items  assured  that  each  of  the 
subarea  items  had  bnen  considered  carefully  by  the  14  experts  and  that  very 
little  disagreement  existed  as  to  the  priority  of  the  items. 

Table  7  provides  a  detai  *d  comparison  of  tne  specific  item  ranks 
between  judgments  made  by  the  Vw'  boards  of  experts.  When  lists  did  not 
exactly  match,  due  to  the  revised  J2  decisions  made  by  the  FIC  experts,  the 
mismatched  items  are  shown  at  the  bottom  of  the  list  with  the  ranx  that  the 
particular  item  originally  received.  Ranks  of  items  below  mismatched  items 
were  renumbered  sequentially  to  allow  a  comparison  between  the  two 
prioritized  lists.  Revised  group  judgments  (J2)  from  the  FIC  experts  are 
shown  in  parentheses  next  to  the  original  J1  decisions.  Rho  coefficients 
are  indicated  for  each  comparison,  including  initial  J1  decisions  and 
revised  group  decisions  (J2)  wnere  appropriate.  In  only  one  instance  (list 
10  Clinical  Lab/Blood  Bank)  did  the  revised  group  judgment  decrease  the 
similarity  between  the  groups'  ranks. 

AMEDO  General  Officer  Board  J1-J2  for  Major  Medical  Combat  Deficiencies 

After  items  within  the  major  deficiency  lists  were  prioritized.  General 
Officer  Board  members  rank  ordered  the  13  lists  from  most  to  least  important 
(shown  at  the  bottom  of  Table  5).  Figure  7  presents  the  independent  J1 
judgment  results  of  the  Board  for  the  13  major  areas.  Deficiency  lists 
which  were  disagreed  upon  arid  required  group  discussion  are  indicated  by  an 
asterisk  (*)  Goodness-of-fit  for  the  group  equation  was  fair  to  good 
(.71).  Internal  consistency  among  the  experts'  judgments  was  also  adequate 
(.84).  The  overall  pattern  of  lists  along  the  priority  dimension  was  well 
distributed  as  shown  p^'torially  in  the  graph  and  statistically  by  the 
significance  of  the  F  ratio.  Feedback  information  from  the  "list  of  lists" 
and  from  the  individual  subarea  priorities  was  used  by  the  experts  to  arrive 
at  a  final  revised  group  c  ^sion  (J2). 

List  of  lists  "final  revisions.  Figure  3  displays  the  revised  group 
judgments  of  the  AMEDO  General  Officer  Board.  After  discussion  of  lists  3, 
6,  7,  8,  and  10,  the  group  decided  to  delete  five  major  areas  (Medical 
Loqistics,  Clinical  Lab/Blood  Bank,  Oental,  Veterinary,  and  Optometry/ 
Optical  Services).  Subarea  items  from  those  five  major  areas  were  merged 
into  the  remaining  eight  major  lists.  (See  the  summary  of  revisions  at  the 
bottom  of  Fig.  8.)  In  addition  to  deletions  and  item  movement,  the 
remaining  major  areas  were  renamed  as  shown,  as  a  result  of  further 
discussion,  the  group  unanimously  placed  Casualty  Care/Treatment  as  the 
top-most  priority  and  placed  Casualty  Prevention  as  the  second-most  priority. 
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Table  7 


Comparison  of  F I C  J1-J2  Specific  Item  Ranks  with  AMEDD 
General  Officer  Board  01  Item  Ranks 


Item 

Rank 

FIC 

Order 

AMEDD 

Spearman  Rank 
Difference  Correlation3 

1.  Medical 

Treatment  Oeficiencies 

Resuscitation 

4 

1 

Med/surq  in  battle 

2 

2 

Self/buddy  aid 

1 

3 

Laser/mircowave  injury 

7 

4 

rho  (6  d.f.)  =  .57,n/s 

Combat  stress 

5 

5 

Med  pro  equip  operation 

3 

6 

Maxillofacial 

8 

7 

Dentcl/vet  emergency 

6 

8 

(Monitor  vital  siqn/MOPP) 

• 

(9) 

2.  Medical  Resource  Deficiencies  (was  Force  Structure) 

COMMZ  hospital  assets 

1 

1 

COMMZ  hospital  augmentation 

2 

2 

Clinical  lab  requirements 

4 

3 

MOS/SSI  identifiers 

3 

4 

Civ  structure  conversion 

5 

5 

Field  kitchen 

6 

6 

Optometry  teams  suppor  t 

7 

7 

Vet  svcs  &  DOD  structure 

8 

8 

Med  food  support 

9 

9  rho  (8  d.f.)  =  .99** 

Dental  at  qeneral  hospitals 

10 

10 

(Field  treatment  combat 

stress) 

(2) 

- 

(Power  &  illumination) 

(4) 

- 

3.  Medical  Logistics 

Deficiencies 

Med  resupply 

2 

1 

Eye  protection  (frag  radn) 

5 

2 

Decontaminants  (med  sup) 

6 

3 

Med  unit  mobility  wt/cube 

1 

4 

Dental  field  equip 

11 

5 

Test,  meas,  equip 

7 

6 

Mat  hdlg  med  sup 

9 

7 

Env  protection  (pat  in  evac) 

3 

8 

Refrigeration 

4 

9 

Lens  fabrication 

10 

10  rho  (10  d.f.)  =  .55* 

Covered  stor  (med  sup) 

8 

11 

Field  optometry  equip 

12 

12 

(Monitor  vital  signs/MOPP) 

(5) 

- 

(Power  &  illumination) 

(5) 

a  **  p<.01  ,  *  p<.05,  n/s  = 

nonsignificant 
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Table  7  (continued) 


Item 

Rank 

FIC 

Order 

AMEDD 

Spearman  ?,ank 
Difference  Correlation3 

4.  Patient 

Evacuation 

&  Regulating  Deficiencies 

Air  ground  evac  vehicles 

1 

1 

Ground  ambulance 

2 

2 

Field  medical  records 

3 

3 

rho  (1  d.f.)  *  1.00 

5.  Optometry/Optical  Service  Deficiencies 
Visual  correction/protect 

device  2(1)  1  Initial:  rho  *  -1.00 

Optometry  pers  op  of  equip  1(2)  2  Revised:  rho  *  1.00 

NftTTi  FTCJ?  revised  judgment  reversed  order  of 
2nd  and  3rd  items 


6.  Oental 

Service  Deficiencies 

Oental 

health  of  indiv 

soldier 

1 

1 

Initial:  rho  (1  d.f.) 

Maxillofacial  materiel 

3(2) 

2 

3  .60,  n/s 

Dental 

pers  in  battle 

_ m _ 

3 

Revised:  rho  (1  d.f.) 

NOTE: 

FIC  J2  revised  judgment  reversed  order  of 

3  1.00 

2nd  and  3rd  items 

7.  Veterinary  Service  Deficiencies 


Vet  Corp  officers  in  battle 

1 

1 

rho  3  1 .00 

Working  dog 

2 

2 

8.  Preventive  Medicine  Deficiencies 

Early  warning 

1 

1 

rho  =  1.00 

Med  unit  orq 

2 

2 

9.  Medical  l 

Command,  Control 

,  &  Communication  Deficiencies 

PLRS/JTID  &  systems 

2 

1 

Med  regulating  in  battle 

1 

2 

Intelligence  assets 

3 

3 

rho  (2  d.f.)  *.80,  n/s 

Linguistics  resources 

4 

4 

l/et/dental  communications 

W 

10.  Clinical 

Lab/Blood  Bank 

Services  Deficiencies 

Whole  blood  substitutes 

2 

1 

Blood  distri  in  theater 

1 

2 

Initial:  rho  (3  d.f) 

Lab  volume  capability 

3 

3 

3  .90* 

Blood  bank  team  org 

4(5) 

4 

Revised:  rho  (3  d.f.) 

Blood  shipping  containers 

_ 5(41 _ 

5 

NOTE:  FIC  J2  revised  judgment  reversed  order  of 

3  .80,  n/s 

4th  and  5th  items 

a*p<()5,  n/s  =  nonsignificant 


46 


Table  7  (continued) 


Rank 

Order 

Spearman  Rank 

Item 

FIC 

AMEDO 

Difference  Correlation11 

11.  Chemical  Warfare  Deficiencies 

Chemical  prophylaxis 

1 

1 

Detection 

2 

2 

Decontamination  patients 

4 

3 

MOPP  medical  treatment 

5 

4 

Contamination  equip/supply 

6 

5 

rho  (5  d.f . )=.79* 

Protective  shelter  patients 

3 

6 

Medical  materiel  package 

7 

7 

12.  Nuclear  Environment 

Deficiencies 

Prophylaxis 

2 

1 

Detection 

1 

2 

rho  (1  d.f.)  =.50,  n/s 

Medical  materiel  package 

3 

3 

13.  Biological 

Warfare 

Environment  Deficiencies 

Detection 

1 

1 

Prophylaxis 

2 

2 

rho  (1  d.f.)  =  1.00 

Medical  materiel  package 

3 

3 

Summary  statistics  for  the  revised  group  judgments  were  computed  by 
going  back  to  the  original  J1  card  decks  and  rearranging  the  cards  to 
conform  to  the  group's  revised  order  (J2).  A  new  decision  matrix  was 
constructed  and  multiple  linear  regression  analyses  were  computed  on  the 
rearranged  data  set.  As  shown,  the  goodness-of-f it  for  the  revised  group 
equation  increased  from  R  =  .71  to  R  =  .84  (within  the  good  to  excellent 
range).  A  corresponding  increase  in  inter-rater  reliability  also  emerged 
for  the  02  judgments  (.93  versus  the  original  J1  value  of  .84).  Significant 
differences  were  again  observed  among  the  new  list  averages.  While  lists  6 
(Chemical  Treatment  and  Prevention)  and  3  (Casualty  Evacuation)  were  tied  -- 
mean  =  4.86  —  the  board  unanimously  placed  Casualty  Evacuation  ahead  of 
Chemical  Treatment  and  Prevention.  Again  it  must  be  emphasized  that  such 
extensive  revisions  would  be  very  unlikely  if  the  analyses  relied  upon  only 
nominal  group  input. 

Final  list  of  major  deficiencies  and  rescaled  values.  Table  8  presents 
a  summary  of  the  prioritization  actions  for  the  major  medical  combat  mission 
areas.  Column  1  of  the  table  contains  a  facsimile  of  the  MAA  list  that  was 
prepared  and  distributed  tn  members  of  the  AMEDO  General  Officer  Board  prior 
to  adjournment.  Columns  2  and  3  were  appended  to  provide  an  exact  audit 
trail  of  the  01-J2  decision-making  sequence.  A  summary  of  the  statistical 
indicators  is  shown  at  the  bottom  of  the  table. 
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Figure  7.  AMEDD  General  Officer  Board  independent  judgment  (Jl) 
results  for  major  medical  combat  deficiency  priorities. 
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Summary  of  Revisions 


J1  Independent  Judgment  Lists 

Medicai  Treatment (9)  - - 

Optometry (1)  Clinical/blood(2) 
Dental  (2)  Veterinary (1) 

Preventive  Medicine(l) - < - * 

Logistics (2) 

Medical  Resources  (10) - - - - 

Logistics (11)  Clinical/blood(3) 
Optometry (1)  Preventive  med(l) 
Dental(l)  Veterinary (1) 

Evacuation  and  Regulating (3)  - 4 

Chemical  Warfare (7) - -I 

Command, Control,  Communication^)  — 1 

Biological  Warfare  (3) - - 

Nuclear  Environment (3)  - 4 

fJote:  (  )  indicates  nr.  items  moved. 


J2  Revised  Group  Judgment  Lists 
Casualty  Care/Treatment (15) 

Casualty  Prevention (3+2  new*  *5) 

1 

Medical  Resources (28)  I 


>  Casualty  Evacuation(3) 

■  Chemical  Prev/Treatment (7) 

C3/lntelligence(4) 

Biological  Prev/Treatment (3) 
Nuclear  Prev/Treatment (3) 
*Tvo  items  added  by  MAA  staff 


Figure  8.  AMEDD  General  Officer  Board  revised  group  judgment  (J2) 
results  for  major  medical  combat  deficiency  priorities. 
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Table  8 


/' 


Final  List  of  Major  Medical  Combat  Deficiencies  and  Rescaled  Values 


MAA  Priorities  List 

J1  Average 
List  Rank 

J2  Average 
List  Rank 

0  to  1.0 
Rescaled  Value 

1. 

CASUALTY  CARE/TREATMENT 

1.71 

1.00 

1.000 

Optometry 

Dental 

Clinical  Lab/Blood 

(11.43) 

(  9.57) 

(  8.57) 

2. 

CASUALTY  PREVENTION 

7.43 

2.00 

.857 

3. 

MEDICAL  RESOURCES 

3.57 

4.14 

.551 

Logistics 

Force  Structure 

Vet 

(  6.14) 

(10.14) 

4. 

CASUALTY  EVACUATION 

4.00 

4.86 

.449 

5. 

CHEMICAL  PREVENTION  AND 
TREATMENT 

5.86 

4.86 

.449 

6. 

C3/ INTELLIGENCE 

6.57 

5.86 

.306 

7. 

BIOLOGICAL  PREVENTION 

AND  TREATMENT 

7.86 

6.57 

.204 

8. 

NUCLEAR  PREVENTION  AND 
TREATMENT 

8.14 

6.71 

.184 

Summary  Statistics: 

Goodness-of-flt 

R  »  .71 

.84 

Inter-rater  reliability^ 

Item  rank  mean  differences 

77  »  -84 

.93 

(df1f  df2)  -  (12,78) 

(7,48) 

F  -  6.60, 

16.98, 

£<  .001 

.001 
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After  the  final  prioritized  rank  averages  for  the  medical  mission  areas 
had  been  established,  the  major  area  "list  of  lists"  and  the  subarea  lists 
were  prepared  for  submission  to  the  Logistics  Center  at  Ft  Lee,  Virginia,  to 
be  incorporated  with  other  combat  service  support  MAAs.  To  be  compatible 
with  other  proponent  school  MAA  results,  rank  averages  were  converted  to 
scale  values  ranging  from  0.0  (lowest  possible  rank)  to  1.0  (highest 
possible  rank)  by  the  use  of  a  linear  transformation  equation.  The  resca’ed 
values  produced  by  the  IDM  ranking  process  are  equivalent  to  the  "normalized 
measures  -of  effectiveness"  (0  to  1.0)  produced  by  the  pairwise  comparison 
technique  (TRADQC  Mission  Area  Analysis,  Note  3).  While  both  techniques  are 
based  upon  ipsative  measurement  assumptions,  the  major  difference  between 
the  two  methods  is  that  the  IDM  process  employs  both  nominal  and  interactive 
decision-making  groups  of  experts  but  the  pair-wise  comparison  technique 
models  decisions  based  only  upon  nominal  groups. 

The  linear  transformation  equation  for  converting  the  J2  average  ranks 
to  0  -  1.0  values  employed  the  following  rescaling  equation: 

Y  =  1.143  -  .143  X  ,  [3] 

where  Y  is  the  rescaled  0-1.0  value,  1.142  is  tlie  Y  intercept,  -.143  is 
the  slope  of  the  rescaling  function,  and  X  takes  on  the  values  of  the 
original  J2  rank  averages.  Equivalent  rescaled  values  for  the  MAA 
priorities  are  shown  in  column  four  of  Table  8.  The  nature  of  the 
equivalent  values  is  such  that  an  average  rank  of  1.0  resulted  in  a  rescaled 
value  of  1.0.  Correspondingly,  an  average  rank  of  8  would  result  in  a 
rescaled  value  of  zero  (0.0).  Because  the  lowest  average  rank  was  6.71 
(Nuclear),  the  full  range  of  possible  rescaled  values  is  not  reflected  by 
the  AMEDD  MAA  submission. 

Rescaling  and  Assembly  of  Revised  Subarea  Deficiency  Lists 

Once  the  revised  major  deficiency  areas  had  been  determined  by  the 
General  Officer  Board,  the  subarea  items  contained  in  each  required 
reprioritization  since  several  major  areas  were  merged  (i.e..  Medical 
Resources  and  Medical  Logistics),  and  some  were  deleted  as  major  areas 
(i.e..  Veterinary  and  Optonetry/Optical  Services).  Reprioritization  could 
have  been  accomplished  by  another  day  of  card-sorting  and  IDM  analysis. 
Instead,  rank  order  means  from  the  initial  J1  item  results  were  rescaled  and 
merged  into  the  newly  revised  major  areas  by  forming  summation  scores  which 
credited  rescale  items  with  values  for  the  list  they  appeared  on  and  their 
placement  within  the  particular  major  list. 

First,  the  J1  subarea  item  rank  means  were  rescaled  to  a  common  unit  of 
measurement  using  simple  linear  transformation  equations.  The  transformed 
rank  scale  ranged  from  zero  (lowest  item  priority  rank)  to  1.0  (highest 
priority  rank  =  1).  Table  9  presents  the  rescaling  equations  and  rescaled 
values  for  the  deficiency  subareas.  Items  which  were  to  be  merged  with  or 
moved  to  other  lists  are  identified  also. 

Next,  each  of  the  J1  major  deficiency  area  rank  means  were  transformed 
to  zero-one  scores  with  the  following  rescaling  equation:  Y  =  1.083  -  .083X. 
Zero-one  list  scores  range  from. 94  for  Medical  Treatment  fX  =  1.71)  to  .13 
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Table  9 


0-1.0  Rescaled  Values  for  Subarea  Deficiencies 


AMEDD  General  Officer  Board 


Deficiency  Item  List 

0-1.0 

Value 

Rescaling  Equation/J2  Revision 

1.  Medical  Treatment 

Y  »  1.125-.125X 

Resuscitation 

.82 

Med/surg  In  battle 

.75 

Self /buddy  aid 

.70 

All  Items  Incorporated  into 

Laser /microwave  Injury 

.52 

casualty  care/treatment 

Combat  stress 

.52 

Med  pro  equip  ops 

.46 

Maxillofacial 

.34 

Dental/vet  emergency 

.29 

Monitor  vital  slgn/MOPP 

.11 

2.  Medical  Resources 

Y  *  1. 11-. 117 

COMMZ  hospital  assets 

.98 

COMMZ  hospital  augmentation 

.81 

Clinical  lab  requirements 

.52 

MOS/SSI  Identifiers 

.51 

All  items  remained  in 

Civ  structure  conversion 

.44 

medical  resources 

Field  kitchen 

.43 

Optometry  teams  support 

.40 

Vet  svcs  &  OOD  structure 

.33 

Med  food  support 

.32 

Dental  at  general  hospitals 

.25 

3.  Medical  Logistics 

Y  »  1 .083-. 0837 

Med  resupply 

.77 

Eye  protection  (frag  radn) 

.75— 

Decontaminants  (med  sup) 

.73 

Med  unit  mobility  wt/cube 

.67 

Power  &  illumination 

.56 

Dental  field  equip 

.49 

Test,  meas,  equip 

.44 

Mat  hdlg  med  sup 

.44 

Env  protection  (pat  In  evac) 

.43— 

Refrigeration 

.36 

Lens  fabrication 

.36 

Covered  stor  (med  sup) 

.29 

Field  optometry  equip 

.21 

(With  the  exception  of  the  two 

items 

indicated,  all  Items  moved  to 

medical  resources) 
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Table  9  (continued) 


Deficiency  Item  List  0-1.0  Rescaling  Equation/J2  Revision 

Value 


4.  Patient  Evacuation  &  Regulation  Y  *  1.50-.507 


Air  ground  evac  vehicles 

.86 

Ground  ambulance 

.65 

All  items  incorporated  into 

Field  medical  records 

.0 

casualty  evacuation 

5. 

Optometry/Optical  Service 

Y  *  2.0-1.01 

Visual  corr/protectlon 

.86 . . 

—Moved  to  medical  resources 

Optometry  pers  op  of  equip 

.14 . . 

—Moved  to  casualty  care/treat 

6. 

Dental  Service 

Y  *  1.50-.507 

Dental  health  indiv  soldier 

.79 . . 

—Moved  to  casualty  care/treat 

Maxillofacial  materiel 

.50 - 

—Moved  to  medical  resources 

Dental  pers  in  battle 

.22 - 

—Moved  to  casualty  care/treat 

7. 

Veterinary  Service 

Y  *  2.0-1.07 

Vet  Corp  off  in  battle 

.57 . . 

—Moved  to  casualty  care/treat 

Working  dog 

.43 - 

—Moved  to  medical  resources 

8. 

Preventive  Medicine 

Y  *  2.0-1.07 

Early  warning 

.57 

Incorporated  into  casualty 
prevention 

Medical  unit  organization 

.43 . - 

—Moved  to  medical  resources 

9. 

Medical  Command,  Control,  &  Communication 

Y  =  1. 33-. 337 

PLRS/JTID  &  Systems 

.76 

Med  reg  in  battle 

.71 

All  items  incorporated  into 

Intelligence  assets 

.38 

C3/Intelligence 

Linguistics  resources 

.14 

10. 

Clinical  Lab/Blood  Bank  Services 

Y  *  1. 25-. 257 

Whole  blood  substitutes 

.72 . 

—Moved  to  casualty  care/treat 

Blood  distr  in  theater 

.57 . 

—Moved  to  casualty  care/treat 

Lab  volume  capability 

.43 . 

—Moved  to  medical  resources 

Blood  bank  team  org 

.43 . 

—Moved  to  medical  resources 

Blood  shipping  containers 

.36 . 

—Moved  to  medical  resources 
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Table  9  (continued) 


Deficiency  Item  List  0- 

1.0 

Rescaling  Equation/J2  Revision 

Value 

11.  Chemical  Warfare 

Y  *  1.167-.167I 

Chemical  prophylaxis 

.88 

Detection 

.72 

Decontamination  patients 

.60 

All  items  Incorporated  into 

MOPP  medical  treatment 

.45 

chemical  prevention/threat 

Decontamination  eaulp/sup 

.33 

Protective  shelter  pat 

.29 

Medical  mat  packaqe 

.24 

12.  Nuclear  Environment 

Y  =  1.50-.50I 

Prophylaxis 

.86 

All  items  Incorporated  into 

Detection 

.57 

nuclear  prevention/threat 

Med  materiel  packaqe 

.07 

13.  Biological  Warfare  Environment 

Y  *  1.50-.517 

Detection 

.72 

All  items  incorporated  into 

Prophylaxis 

.72 

biological  prevent! on/thr -“at 

Med  materiel  packaqe 

.07 

Two  new  items  appended  to  casualty  prevention 

Koni tor/correct  health  hazards 

• 

Doctrine,  tnq  for  combat  stress  - 

NOTE:  Rescaling  equations  were  applied  to  Item  rank  averages,  5T,  to  produce 
the  linearly  transformed  0  to  1.0  value  Y.  Rescaling  equations  are 
of  the  general  form:  Y  =»  a  +  b7  where  Y  Is  a  predicted  score,  a  is 
the  Y  Intercept,  b  Is  the  slope,  and  T  is  the  raw  rank  average 
score.  Rescaling  equations  vary  depending  on  the  number  of  Items  per 
list. 

for  optc^etry/optical  services  (X  =  11.43).  Final  item  scores  were  then 
calculated  for  subareas  by  the  sum  of  the  transformed  item  value  (placement 
within  a  list)  and  the  corresponding  major  list  score. 

Items  for  merged  lists  were  resequenced  according  to  the  magnitude  of 
their  final  item  scores.  The  final  prioritized  lists  of  subarea 
deficiencies  from  the  AMEDD  General  Officer  Coard  are  at  Appendix  III. 
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The  final  prioritization  results  of  the  AMEDD  General  Officer  Board  were 
included  as  Chapter  13  in  the  detailed  200-page  Medical  Substudy  report  for 
Combat  Service  Support  Mission  Area  Analysis  (Level  II)  by  the  Directorate 
of  Combat  Developments,  AHS,  Ft.  Sam  Houston,  TX  (Note  4).  Examples  of  the 
proposed  corrective  actions  for  the  top  two  mission  areas  (Casualty  Care  and 
Treatment  and  Casualty  Prevention)  are  contained  in  Appendix  IV. 
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DISCUSSION  AND  CONCLUSIONS 


The  results  of  this  reseach  provide  evidence  that  the  application  of  the 
Iterative  Decision  Method  (IDM)  Increases  the  productivity  of  expert  group 
decision  making.  This  finding  supports  the  hypothesis  that  a  systematic 
sequence  of  independent  and  revised  group  judgments  produces  more  effective 
and  efficient  judgment  results  than  the  exclusive  use  of  either  nominal 
group  surveys  or  typical  interactive  group  meetings.  Results  from  both  the 
AHS  Force  Integration  Committee  and  the  AMEDD  General  Officer  Board  experts 
indicated  that  discussion  of  independent  judgments  (J1  feedback)  led  to  more 
accurate  revised  group  judgments  (J2).  Further,  the  members  felt  that  group 
revisions  of  item  priorities  utilized  their  expertise  to  a  greater  degree. 
Experts  also  reported  they  were  more  confident  about,  and  more  satisfied 
with,  the  J2  decision  results.  Opportunities  for  interactive  revision  of 
judgments  would  not  have  existed  if  nominal  group  surveys,  regardless  of 
magnitude,  had  been  employed  in  this  study.  Conversely,  a  board  convened 
without  the  resources  of  J1  feedback  results  would  have  lacked  full 
information  about  independent  judgments  in  regard  to  mission  areas  of  prior 
agreement  and  disagreement.  The  number  and  nature  of  revisions  made  by  both 
expert  panels,  and  in  particular  the  latter  group,  clearly  demonstrated  the 
viability  of  iterative  decision  making. 

While  similar  conclusions  have  been  reached  by  Nominal  Group  Technique 
and  Delphi  process  investigations  (Delbecq  et  al.,  1975),  the  primary 
advantage  of  the  IDM  is  that  item  decisions  and  disagreements  are 
quantified,  displayed,  and  explicitly  identified.  The  validity  of  the  IDM 
process  was  also  demonstrated  by  the  highly  similar  findings  obtained  across 
expert  panels  for  levels  of  prediction,  inter-rater  reliability,  item 
dispersion,  und  patterns  of  deficiency  item  prioritization. 

Medical  Input  to  the  U.S.  Army  Mission  Area  Analysis  Program  and  Recommended 
Corrective  Actions 


The  independent  and  revised  group  judgment  (J1-J2)  results  of  this  study 
provide  a  defensible  and  comprehensive  record  of  the  prioritization  of  68 
specific  medical  combat  support  deficiencies  and  the  proposed  corrective 
actions  for  each.  Subareas  were  grouped  and  prioritized  within  eight  major 
medical  mission  areas.  These  decision-making  products  represent  the 
intensive  effort  on  the  part  of  the  Army  Medical  Department  to  assure  that 
proposed  solutions  for  priority  medical  mission  deficiencies  will  be 
targeted  for  development  and  implementation.  The  eight  prioritized  mission 
areas  included:  1)  Casualty  Care  and  Treatment,  2)  Casualty  Prevention,  3) 
Medical  Resources,  4)  Casualty  Evacuation,  5)  Prevention  and  Medical 
Treatment  in  Chemical  Warfare,  6)  Medical  Command,  Control,  and 
Communications/Intelligence,  7)  Prevention  and  Medical  Treatment  in 
Biological  Warfare,  and  8)  Prevention  and  Medical  Treatment  in  Nuclear 
Warfare. 

The  dual  emphasis  on  prevention  and  treatment  generally  associated  with 
the  prioritized  mission  areas,  and  in  particular  with  the  top  four  areas, 
reflects  historical  combat  casualty  trends  described  by  several  medical 
observers  (Neel,  1973;  Reister,  1973).  Casualty  records  from  three 
conventional  wars  over  the  past  40  years  consistently  have  indicated  that 
the  largest  proportion  of  hospital  admissions  in  the  theater  of  operations 


56 


were  due  to  the  cumulative  effects  of  disease.  This  was  especially  true  in 
Korea  and  Vietnam  where  malaria  and  viral  hepatitis  reduced  the  number  of 
soldiers  available  for  duty  and  subsequently  impacted  troop  strength  and 
unit  capabilities.  The  fact  that  medical  personnel  were  equally  susceptible 
to  disease  compounded  the  problem.  Indicative  of  priorities  1  through  3, 
both  medical  c<*re  and  prevention  programs  and  the  resources  required  to 
support  them  were  necessary  to  control  and  lower  the  incidence  of  disease. 
Although  admissions  due  to  disease  occurred  at  a  higher  rate,  the  length  of 
time  away  from  duty  was  shorter  for  disease  casualties  than  for  casualties 
that  sustained  battle  wounds  and  injuries.  Wounds  and  injuries  usually 
required  immediate  surgical  treatment  (priorities  1  and  3)  and  carried  a 
higher  probability  of  evacuation  (priority  4).  Finally,  it  appears  that  the 
prevention  and  treatment  concerns  from  the  conventional  theater  of 
operations  have  been  projected  to  the  chemical,  biological,  and  nuclear 
arenas  as  wel 1 . 

The  implications  of  the  presen*  findings  imoact  upon  management 
activities  at  many  levels.  The  corrective  actions  associated  with  the 
priorities  translate  into  medical  mission  requirements  that  will  be 
aggregated  with  requirements  at  the  combat  service  support  level  which  will 
be  input  to  both  Army  and  DOD  level  missions.  Due  to  limited  funds, 
personnel,  and  state-of-the-art  technology,  not  all  corrective  actions  can 

be  fully  implemented.  However,  the  top  mission  requirements  will  directly 

influence  the  direction  of  research  efforts,  systems  development,  and  the 
allocation  of  military  funds.  In  turn,  new  medical  technologies,  equipment, 
and  procedures  Will  result  in  new  medical  job  requirements. 

Having  observed  the  broader  implications  of  these  results,  it  is 
necessary  to  consider  the  challenging  impact  that  the  /rrective  actions 
will  have  upon  th?  management  of  AMEDD  training  and  training  development 
programs.  Because  many  tasks  performed  by  Army  medical  officers  and 

enlisted  personnel  are  technical  in  nature,  individual  soldiers  assigned  to 
TOE  field  units  (versus  TDA  fixed  facilities)  for  extended  periods  of  time 
are  faced  with  having  to  relearn  some  performance  skills  they  have  lost 
since  formal  schooling  and  Phase  I  and/or  II  training.  Further,  due  to  the 
rapid  development  of  medical  services  and  procedures,  emergent  job 

requirements  cause  some  previously  learned  skills  to  become  obsolete  while 
simultaneously  creating  completely  new  performance  skills  and  procedures 
that  must  be  acquired.  A  cursory  examination  of  the  corrective  actions 
required  for  the  top  two  priorities  of  Casualty  Care/Treatment  and  Casualty 
Prevention  (see  Appendix  IV)  renders  a  profusion  of  required  training 
concerns  which  impact  nearly  every  subarea  deficiency.  The  potential 
utility  of  these  prioritized  combat  service  deficiencies  for  the 
identification  of  individual  ard  collective  medical  training  requirements  is 
great,  and  will  likely  prove  to  be  invaluable  for  furture  planning, 
analysis,  design,  and  development  of  training  materials  and  services. 


Implications  of  IDM  Application  of  AMEDD  Decision  Making 

The  Iterative  Decision  Method  (IDM)  process  consists  of  1 )  a  systematic 
sequence  for  obtaining  independent  and  revised  group  judgments  (J1-J2)  from 
a  panel  of  5  or  7  experts,  2)  a  set  of  special  application  computer  programs 
for  the  generation  and  analysis  of  multiple  linear  regression  decision 
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equations,  and  3)  a  standardized  format  for  the  graphic  display  of  decision 
results.  The  technique  can  be  used  for  making  selection  decisions 
(dichotomous  variables,  e.g.,  1  ■  select,  0  *  nonselect)  or  prioritization 
decisions  (scaled  ratings  or  rank  order  judgments)  about  a  well  defined 
collection  of  persons,  objects,  or  events  identified  by  some  form  of 
front-end-analysis.  Since  the  IDM  is  modular,  it  can  be  used  alone  or  in 
continuing  Iterations  of  selection  and/or  prioritization  sequences.  In 
addition  to  its  present  use  in  the  prioritization  of  major  and  subarea 
medical  combat  deficiencies  which  linked  the  decision  making  of  two  expert 
panels,  the  technique  has  been  successfully  employed  for  the  selection  of 
medical  tasks  for  training  and  for  the  prioritization  of  tasks  into  combat 
critical,  mission  essential,  and  other  essential  categories  (Finstuen, 
Note  1;  Carroll  &  Finstuen,  Note  2).  Because  of  the  modular  flexibility  of 
the  IOM,  the  process  could  easily  be  adapted  for  expert  panels  concerned 
with  the  selection  and/or  prioritization  of  project  workloads,  for  budget 
and  funding  allocations  and  requests,  personnel  promotions,  assignments  for 
critical  or  sensitive  jobs,  equipment  and  project  evaluations,  construction 
and  zoning  problems,  patient  classification,  and  numerous  other  management 
planning  and  programming  activities  where  an  efficient  and  effective  means 
for  group  decision  making  is  required. 
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Appendix  I.  Force  Integration  Committee 
Mission  Area  Analysis  -  J1  Deficiency  Lists 
and  Examples  of  Cards  For  Two  Subarea  Items 


MEDICAL  SUB-STUDY  COMBAT  SERVICE  SUPPORT  MISSION  AREA  ANALYSIS 

DEFICIENCIES 

1.  MEDICAL  TREATMENT  ON  THE  BATTLEFIELD  IS  INADEQUATE: 

a.  Inadequate  treatment  regimes  for  laser /microwave  injuries. 

b.  Inadequate  resuscitation  management  system. 

c.  Inadequate  medical/surgical  treatment  capability  for  battlefield 
injuries. 

d.  Inadequate  capability  for  prevention,  diagnosis,  and  treatment  of 
combat  stress  reactions  and  neuropsychiatric  disorders. 

e.  Individual  soldier's  capability  to  perform  self/buddy  aid  is 
Inadequate. 

f.  Medical  professional  and  para-professional  personnel  are  unable  to 
adequately  perform  treatment  tasks  and  operate  field  medical  equipment. 

g.  Veterinary  and  dental  corps  officer's  ability  to  perform  emergency 
medical  treatment  Is  inadequate. 

h.  Inability  to  provide  treatment  and  post-operative  management  of 
maxillofacial  injuries  and  wounds. 

SAMPLE  CARDS  FOR  ITEMS  a  and  b 


wurmr mrawRT 

DEFICIENCIES 


A.  Inadequate  tre 
microwave  inju 


ITEM  1 

MEDICAL  TREATMENT  J 

DEFICIENCIES 

b.  Inadequate  resuscitation  management 

system. 
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2.  MEDICAL  FORCE  STRUCTURE  ON  THE  BATTLEFIELD  IS  INADEQUATE: 


a.  Combat  zone  and  COMMZ  hospital  assets  are  Insufficient  to  meet  the 
requirements  of  the  integrated  battlefield. 

b.  Inadequate  plans  to  provide  for  adaptation  of  existing  civilian 
structures  for  field  hospital  use. 

c.  Power  distribution  and  illumination  systems  in  medical  and  dental 
units  are  inadequate. 

d.  COMMZ  level  hospitals  are  not  capable  of  augmenting  and/or 
reconstituting  corps  level  treatment  facilities. 

e.  Insufficient  veterinary  service  units  exist  to  support  a  total  DOD 
mobilization  force  structure. 

f.  Optometry  teams  are  inadequate  to  provide  optometrical  support 
under  current  basis  of  allocation  rules. 

g.  Inability  to  identify  professional  and  para-professional  medical 
personnel  with  specialized  skills  using  the  current  MOS  identifiers. 

h.  Inadequate  medical  food  service  support  at  theater  hospitals. 

i.  Inadequate  dental  hygiene  support  at  the  general  hospitals  and 
convalescent  centers. 

j.  Clinical  laboratory  requirements  exceed  capability  using  current 
equipment  and  methodologies. 

k.  Inadequate  field  treatment  and  convalescent  facilities  present  in 
the  initial  phase  to  restore  projected  case  loads  of  minor  wounds,  DNBI,  and 
combat  stress  casualties  to  duty. 


3.  MEDICAL  LOGISTICS  ON  THE  BATTLEFIELD  ARE  INADEQUATE: 


a.  Spectacle  lens  fabrication  capability  in  the  field  is  inadequate. 

b.  Current  field  optometry  equipment  is  severely  degraded  by 
environmental  conditions  on  the  battlefield. 

c.  Inadequate  eye  protection  from  high  velocity  fragments  and  high 
Intensity  electromagnetic  radiations  results  in  preventable  casualties. 

d.  The  ability  to  monitor  vital  signs  is  inadequate  during  evacuation 
in  MOPP  or  cold  weather  conditions. 

e.  Inadequate  environmental  protection  for  patients  during  evacuation. 

f.  Medical  resupply  support  is  inadequate. 

g.  Current  decontaminants  are  inadequate  for  decontaminating  medical 
materiel,  supplies,  and  equipment. 

h.  Current  refrigeration  capability  in  medical  treatment  facilities  is 
Inadequate. 

i.  Materiel  handling  equipment  for  medical  supplies  is  inadequate. 

j.  Test,  measurement,  and  diagnostic  equipment  for  medical  items  is 
Inadequate. 

k.  Medical  units  lack  the  mobility  necessary  to  keep  up  with  supported 
units  due  to  weight  and  cube  of  facilities,  materiels,  and  supplies. 

l.  Dental  field  equipment  items/sets  are  inadequate  for  dental 
operations. 

m.  Present  assets  to  provide  covered  storage  for  medical  supplies  are 
inadequate. 
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4.  PATIENT  EVACUATION  AND  MEDICAL  REGULATING  ON  THE  BATTLEFIELD  IS 
INADEQUATE: 

a.  Ground  ambulances  are  inadequate  to  evacuate  the  large  number  of 
patients  generated  on  the  battlefield. 

b.  Current  field  medical  records  system  on  the  integrated  battlefield 
is  antiquated. 

c.  Air  and  ground  evacuation  vehicles  lack  mobility  and/or 
survivability  in  forward  areas  of  the  battlefield. 


5.  OPTOMETRY/OPTICAL  SERVICES  ON  THE  BATTLEFIELD  ARE  INADEQUATE: 

a.  Currently  available  visual  correction/protection  devices  for  the 
individual  soldier  (spectacles,  contact  lenses,  sunglasses)  are  incompatible 
with  battlefield  requirements. 

b.  Optometry  officers  and  enlisted  personnel  are  unable  to  operate 
their  TOE  equipment  in  the  battlefield  environment. 


6.  DENTAL  SERVICES  ON  THE  BATTLEFIELD  ARE  INADEQUATE: 

a.  Dental  personnel's  ability  to  function  in  a  battlefield  environment 
and  operate  dental  field  equipment  is  inadequate. 

b.  Poor  dental  health  of  the  individual  soldier  results  in  preventable 
dental  casualties. 

c.  Current  materiels  and  treatment  methodologies  for  maxillofacial 
injuries  are  inadequate  to  provide  responsive  resuscitative  care. 


7.  VETERINARY  SERVICES  ON  THE  BATTLEFIELD  ARE  INADEQUATE: 

a.  Veterinary  services  for  the  military  working  dog  on  the  battlefield 
are  inadequate. 

b.  Veterinary  corps  officers  and  enlisted  personnel  are  not  fully 
capable  of  performing  required  veterinary  services  on  the  battlefield. 
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8.  PREVENTIVE  MEDICINE  SERVICES  ON  THE  BATTLEFIELD  ARE  INADEQUATE: 

a.  Preventive  medicine  units  are  inadequately  organized  for  deployment 
and  function  on  the  integrated  battlefield. 

b.  Preventive  medicine  services  lack  the  capability  to  detect, 
identify,  and  provide  early  warning  of  disease  and  biological  warfare  agents 
on  the  battlefield  and  in  the  individual  soldier. 


9.  MEDICAL  COMMAND,  CONTROL,  AND  COMMUNICATION  ON  THE  BATTLEFIELD  ARE 
INADEQUATE: 

a.  Insufficient  communication  capability  available  to  veterinary  and 
dental  detachments  on  the  battlefield  precludes  responsive  mission 
accomplishment. 

b.  Major  deficiencies  in  C^  will  exist  if  the  following  systems  are 
not  fielded  by  projected  initial  operational  capability: 

PLRS/JTIDS  Hybrid 

SINCGARS 

IHFR 

TACCS 

DAS-3 

TAMMIS 

CSS/CCS 

c.  Insufficient  linguistic  resources  currently  exist  within  the  AMEDD 
in  Russian,  Russian  satellite  (Eastern  European),  and  mid-eastern  foreign 
languages  to  provide  medical  intelligence  essential  to  friendly  forces  on 
the  battlefield. 

d.  The  command,  control,  and  communication  of  medical  regulating  on 
the  battlefield  are  inadequate. 

e.  Dedicated  medical  intelligence  assets  are  unavailable  to  acquire 
and  process  critical  data  on  disease/CBR  threats  at  division  and  corps 
levels. 


I 


70 


10.  ClINCAL  LABORATORY  AND  BLOOD  BANK  SERVICES  ARE  INADEQUATE: 


a.  Clinical  laboratory  capability  to  provide  the  required  high  volume 
of  procedures  is  inadequate. 

b.  Blood  shipping  containers  are  inadequate. 

c.  Blood  bank  team  organizations  do  not  allow  for  completion  of  the 
mission  on  the  battlefield. 

d.  Whole  blood  substitutes  are  inadequate. 

e.  Blood  distribution  in  the  theater  of  operations  is  inadequate. 


11.  MEDICAL  HEALTH  SERVICE  SUPPORT  IN  A  CHEMICAL  ENVIRONMENT  IS  INADEQUATE: 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  chemical  contamination. 

b.  Medical  equipment  and  supplies  are  rendered  non-useable  by  chemical 
contamination. 

c.  Inadequate  collective  protection  shelters  for  medical  units. 

d.  MOPP  decrements  medical  personnels'  ability  to  treat. 

e.  Inability  to  decontaminate  patients  and  medical  supplies  and 
equipment. 

f.  Lack  of  adequate  chemical  prophylaxis,  antidotes,  and  therapeutic 
compounds. 

g.  Medical  materiel  packaging  is  inadequate  to  protect  against 
chemical  contamination. 


12.  MEDICAL  HEALTH  SERVICE  SUPPORT  IN  A  NUCLEAR  ENVIRONMENT  IS  INADEQUATE: 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  radiological  contamination. 

b.  Lack  of  adequate  radiological  prophylaxis,  antidotes,  and 
therapeutic  compounds. 

c.  Medical  materiel  packaging  is  inadequate  to  protect  against 
radiological  contamination. 
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INADEQUATE^  HEAL™  SERVIC£  SUPPORT  IN  A  BIOLOGICAL  ENVIRONMENT  IS 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  biological  contamination. 

b.  Lack  of  adequate  biological  prophylaxis,  antidotes,  and  therapeutic 
compounds. 

.  ,  c*  Medical  materiel  packaging  is  inadequate  to  protect  aqainst 
biological  contamination.  s 
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Appendix  II.  AMEDD  General  Officer  Board 

J1  Deficiency  Lists  and  Sample  Fact  Sheets 
for  Subarea  Deficiencies 
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Medical  Treatment  Deficiencies 


1.  Medical  treatment  capability  Is  Inadequate  to  treat  and  return  large 

numbers  of  slightly  disabled  soldiers  to  battle  and  to  preserve  life 

and  function  among  the  seriously  injured. 

a.  Inadequate  treatment  regimens  for  laser /microwave  injuries. 

b.  Inadequate  resuscitation  capability  for  mass  casualties. 

c.  Inadequate  medical/surgical  treatment  capability  for  battlefield 
injuries. 

d.  Inadequate  capability  for  prevention,  diagnosis,  and  treatment  of 
combat  stress  reactions  and  neuropsychiatric  disorders. 

e.  Individual  soldiers'  capability  to  perform  self/buddy  aid  is 
inadequate. 


f.  Medical  professional  and  para-professional  personnel  are  unable  to 
adequately  perform  treatment  tasks  and  operate  field  medical  equipment. 

g.  Dental  corps  officers'  ability  to  perform  emergency  medical 
treatment  is  inadequate. 

h.  Inability  to  provide  treatment  and  post-operative  management  of 
maxillofacial  injuries  and  wounds. 

1.  The  ability  to  monitor  vital  signs  is  inadequate  during  evacuation 
in  MOPP  or  cold  weather  conditions. 
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IC  I^NC  .  :  Inndeauate  treatment  reci"* 


crovave  imurics. 


Immmm 


Dc.5CP.IP.kIG?>:  There  is  inadequate  knowledge  of  basic  biophysical  cellular  and  organ 
effect  of  laser,  microwave,  and  millimeter  wave  energy.  Doctrine  is  as  yet  unsettled  on 
management  of  casualties  from  these  energy  sources  as  there  are  still  unanswered  questions 
s  to  extent  and  types  of  injuries  from  them.  Although  eye  injuries  are  more  likely  from 
these  sources,  the  potential  of  other  organ  injury  is. as  yet  undefined.  Eye  protection 
from  multiband  laser  effects  is  also  not  yet  provided.  Psychological  effects  of  employment 
bf  these  energy  sources  as  weapon  systems  has  not  been  addressed. 


DRIVING  MClOX:  ina<jequate  knowledge  of  effects  of  those  nonionizing  radiation  | 
energy  sources  on  che  body  seriously  limits  doctrinal  decisions  which  in  turn  precludes  j 
training  for  either  protection  or  management  of  injury. 


CORRECTIVE  ACTIO.'.':  Hid 

(67-92) 

1.  Develop  biophysical  data  base  of  nonionizing  radiation  injury.  XT 

2.  Develop  doctrine  for  avoidance,  protection,  and  treatment  of  inury.  X 


Far 

1 93-93) 


3.  Develop  training  program  based  on  doctrine  for  self  aid/buddy  aid 

to  include  psychological  stresses.  X 

4.  Develop  training  program  based  on  doctrine  for  all  levels  of  medi¬ 
cal  treatment  personnel.  •  X 

5.  Develop  eye  protection/body  protection  for  nonionizing  radiation  injuries. 

6.  Develop  treatment  materiel  for  such  injuries.  X 

7.  Develop  medical  management  programs  for  such  injuries.  X 
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MISSION  AS 


Medical  Treatment. 


esuscitat 
sis,  flui 
and  deve 


DRIVING  FACTOR:  Based  on  threat  forces"’ capability  to  inflict  high  numbers  of  casualties^ 
an  improved  management  system  for  resliscitative  patients  is  needed.  D 


CORRECTIVE  ACTION:  Mid  Far 

(87-92)  (93-93) 

1.  Develop  an  integrated  systems  approach  for  resuscitation  manage¬ 
ment  including  triage,  treatment  and  proper  resource  utilization.  X 

2.  Adopt  appropriate  state-of-the-art  and  near-term  technological 

advances  in  devices,  equipment  and  treatment  compounds.  v  X 

2.  Develop  training  packages  incorporting  2.  above.  X 


PROPONENT  SCHOOL 


OFFICE 
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NAME 

LTC  joe  M.  Burt 


ALTOVON 

471-4300/6365 


HQ  TRACOC 


CLASSIFIED  o: 


DEFICIENCY:  Inadequate  Medical  and  Surgical  Treatment  Caoabilitv  for  Battlefield  Inlurie! 


I3SIQN  AP.cA  ?.-F :  Medical  Treatment 


DESCFvIPTION :  Lack  of  knowledge  on  biophysiological  processes  involved  in  battlefield  1 
injuries  hinders  treatment  and  optimal  medical  management  of  injured  soldiers.  Appro¬ 
priate  treatments/compounds  are  sometimes  not  available. 


DRIVING  FACTOR:  The  threat  force  capability  to  inflict  large  numbers  of  casualties  on  j 
tne  high  intensity  battlefield  requires  optimum  useage  of  all  medical  resources.  | 


CORRECTIVE  ACTION: 

Mid 

Far 

1 

1 

(S7-9?) 

(93-93) 

1 

1.  Develop  an  expanded  biophysiological  data  base  for  all  injury 

i 

categories  to  enable  appropriate  doctrinal  changes. 

X 

I 

i 

2.  Adjust  all  training  programs  as  new  knowledge  is  incorporated. 

• 

! 

i.e.,  individual  and  collective  programs.  , 

X 

• 

» 

3.  Materiel  changes  will  follow  developments  from  basic  research 

•  i 

as  new  drugs  and  other  treatment  compounds  emerge. 

X 

* 

• 

i 

• 

• 
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Medical  Resource  Deficiencies 


2.  Medical  resources  on  the  projected  battlefield  are  Inadequate  to  treat, 

process,  and  evacuate  the  wounded,  injured  and  ill  and  to  reconstitute 

medical  unit  losses. 

a.  Combat  zone  and  COMMZ  hospital  assets  are  insufficient  to  meet  the 
requirements  of  the  integrated  battlefield. 

b.  Inadequate  plans  exist  to  convert  civilian  structures  for  hospital 

use. 

c.  COMMZ  level  hospitals  are  incapable  of  augmenting  and/or 
reconstituting  corps  level  treatment  facilities. 

d.  Insufficient  veterinary  service  units  exist  to  support  a  total  DOD 
mobilization  force  structure. 

e.  Optometry  teams  are  inadequate  to  provide  optometrical  support 
under  current  basis  of  allocation  rules. 

f.  Medical  food  service  support  at  theater  hospitals  is  inadequate. 

g.  Dental  hygiene  support  at  the  general  hospitals  and  convalescent 
centers  Is  inadequate. 

h.  Clinical  laboratory  requirements  exceed  capability,  using  current 
equipment  and  methodologies. 

1.  The  field  kitchen  system  to  provide  medical  food  service  in  the 
theater  is  inadequate. 

j.  Current  MOS  and  SSI  identifiers  are  insufficient  to  adequately 
Identify  professional  and  para-professional  medical  personnel  with 
specialized  skills. 
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Medical  Logistics  Deficiencies 


3.  Current  medical  logistics  capability  is  inadequate  to  provide  the 

types,  levels  and  components  of  supplies  and  equipment  necessary  to 

efficiently  support  the  battlefield  force;  further,  medical  mobility  is 

incompatible  with  fighting  force  units'  mobility  capacity. 

a.  Spectacle  lens  fabrication  capability  in  the  field  is  inadequate. 

b.  Current  field  optometry  equipment  is  severely  degraded  by 
environmental  conditions  on  the  battlefield. 

c.  Inadequate  eye  protection  from  high  velocity  fragments  and  high 
intensity  electromagnetic  radiations  results  in  otherwise  preventable 
casualties. 

d.  Inadequate  environmental  protection  exists  for  patients  during 
evacuation. 

e.  Medical  resupply  support  is  inadequate. 

f.  Current  decontaminants  are  inadequate  for  medical  materiel, 
supplies,  and  equipment. 

g.  Current  refrigeration  capability  in  medical  treatment  facilities  is 
inadequate. 

h.  Materiel  handling  equipment  for  medical  supplies  is  inadequate. 

i.  Test,  measurement,  and  diagnostic  equipment  for  medical  equipment 
is  inadequate. 

j.  Medical  units  lack  the  mobility  necessary  to  keep  up  with  supported 
units  due  to  weight  and  cube  of  facilities,  materiels,  and  supplies. 

k.  Dental  field  equipment  items/sets  are  inadequate  for  dental 
operations. 

l.  Present  assets  to  provide  covered  storage  for  medical  supplies  are 
inadequate. 

m.  Power  distribution  and  illumination  systems  in  medical  and  dental 
units  are  inadequate. 
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Patient  fvacuation  and  Regulating  Deficiencies 


4.  Patient  evacuation  capacity  and  medical  patient  regulating  are 
inadequate  to  transport  and  regulate  the  projected  types  and  numbers  of 
battlefield  casualties,  resulting  In  increased  morbidity  rates  as  well 
as  burdening  forward  units'  transportation  resources. 

a.  Ground  ambulances  are  too  few  and  inadequate  to  evacuate  the  large 
number  of  patients  generated  on  the  battlefield. 

b.  Current  field  medical  records  system  on  the  Integrated  battlefield 
Is  Inadequate. 

c.  Air  and  ground  evacuation  vehicles  lack  mobility  capacity  and/or 
survivability  in  forward  areas  of  the  battlefield. 
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Optometry/Optical  Service  Deficiencies 


5.  Optometry/optical  services  and  resources  are  inadequate  to  preserve 
critical  visual  function  of  the  engaged  battlefield  force. 

a.  Currently  available  visual  con  ^tion/protection  devices  for  the 
individual  soldier  (spectacles,  contact  lenses,  sunglasses)  are  incormtible 
with  battlefield  requirements. 

b.  Optometry  officers  and  enlisted  personnel  are  unable  to  :perate 
their  TOE  equipment  in  the  battlefield  environment. 
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Dental  Service  Deficiencies 


6.  Dental  services  on  the  battlefield  are  Inadequate  to  provide  quick 
medical/surgical  care  to  soldiers  on  the  battlefield  and  to  prevent, 
treat,  and  promptly  return  dental  casualties  to  battle. 

a.  Ability  of  dental  personnel  to  function  in  a  battlefield 
environment  and  operate  dental  field  equipment  is  inadequate. 

b.  Poor  dental  health  of  individual  soldiers  results  in  preventable 
dental  casualties  and  their  loss  from  battlefield  engagement. 

c.  Current  materiels  and  treatment  methodologies  for  maxillofacial 
injuries  are  inadequate  to  provide  responsive  resuscitative  care. 
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Veterinary  Service  Deficiencies 


7.  Veterinary  resources  and  services  on  the  battlefield  are  inadequate  to 
insure  safety  of  subsistence  items  to  the  combatant  force,  to  provide 
emergency  medical/surgical  support,  and  to  assure  the  continued 
functioning  of  military  working  dogs. 

a.  Veterinary  services  for  the  military  working  dog  on  the  battlefield 
are  insufficient. 

b.  Veterinary  corps  officers  and  enlisted  personnel  are  not  fully 
capable  of  performing  required  veterinary  services  on  the  battlefield. 
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Preventive  Medicine  Deficiencies 


8.  Preventive  medicine  services  and  resources  are  inadequate  to  prevent 
disease  debilitating  to  the  fighting  force  on  the  integrated 
battlefield. 

a.  Preventive  medicine  units  are  inadequately  organized  for  deployment 
and  function  on  the  integrated  battlefield. 

b.  Preventive  medicine  services  lack  the  capability  to  detect, 
identify,  and  provide  early  warning  of  disease  and  biological  warfare  agents 
on  the  battlefield  and  in  the  individual  soldier. 
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Medical  Command,  Control,  and  Communications  Deficiencies 


9.  Medical  command,  control  and  communication  are  inadequate  to  coordinate 
essential  medical  units'  activities  at  all  levels  on  the  integrated  and 
electronic  warfare  battlefields. 

a.  Major  deficiencies  in  exist  in  the  absence  of  the  following 
systems: 


PLRS/JTIDS  Hybrid 

SINCGARS 

IHFR 

TACCS 

DAS-3 

TAMM IS 

CSS/CCS 

b.  Insufficient  linguistic  resources  currently  exist  within  the  AMEDD 
in  Russian,  Russian  satellite  (Eastern  European),  and  mid-eastern  foreign 
languages  to  provide  medical  intelligence  essential  to  friendly  forces  on 
the  battlefield. 

c.  The  command,  control,  -nd  communication  of  medical  regulating  on 
the  battlefield  are  inadequate. 

d.  Dedicated  medical  intelligence  assets  are  unavailable  to  acquire 
and  orocess  critical  data  on  disease/CBR  threats  at  division  and  cc**ps 
levels. 
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10.  Clinical  laboratory  and  blood  bank  services  are  Inadequate  to  process 
the  required  high  volume  of  laboratory  procedures  and  to  collect, 
process,  and  distribute  blood  requirements. 

a.  Clinical  laboratory  capability  to  provide  the  required  high  volume 
of  procedures  Is  inadequate. 

b.  Blood  shipping  containers  are  inadequate. 

c.  Blood  bank  team  organizations  do  not  allow  for  completion  of  the 
mission  on  the  battlefield. 

d.  Whole  blood  substitutes  are  Inadequate. 

e.  Blood  distribution  in  the  theater  of  operations  is  inadequate. 
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Medical  Support  Deficiencies  in  CW 


11.  Medical  support  in  a  chemical  environment  is  inadequate  to  return 

casualties  to  the  battlefield  or  to  preserve  the  lives  of  projected 

numbers  of  chemical  casualties. 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  chemical  contamination. 

b.  Medical  equipment  and  supplies  are  rendered  non-useable  by  chemical 
contamination. 

c.  Inadequate  collective  protection  shelters  exist  for  medical  units' 
treatment  of  chemical  casualties. 

d.  MOPP  decrements  medical  personnels'  ability  to  treat. 

e.  Capacity  to  decontaminate  patients  and  medical  supplies  and 
equipment  is  inadequate. 

f.  Chemical  prophylaxis,  antidotes,  and  therapeutics  are  inadequate. 

g.  Medical  materiel  packaging  is  inadequate  to  protect  against 
chemical  contamination. 
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Medical  Deficiencies  in  a  Nuclear  Environment 


12.  Medical  support  in  a  nuclear  environment  is  inadequate  to  function 
effectively  in  radioactive  areas  and/or  to  return  to  duty  or  preserve 
life  of  projected  nuclear  blast/burn/radiation  casualties. 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  radiological  contamination. 

b.  Radiological  prophylaxis,  antidotes,  and  therapeutic  compounds  are 
inadequate  for  projected  needs. 

c.  Medical  materiel  packaging  is  inadequate  to  protect  against  radio¬ 
logical  contamination,  and  EMP. 


Medical  Deficiencies  in  a  BW  Environment 


13.  Medical  support  in  a  biological  environment  is  inadequate  to  protect 
the  force  against  mass  epidemics  due  to  threat  BW  agents  and  to 
conserve  its  capacity  to  fight. 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  biological  contamination. 

b.  Biological  prophylaxis,  antidotes,  and  therapeutics  compounds  are 
inadequate. 

c.  Medical  materiel  packaging  is  inadequate  to  protect  against 
biological  contamination. 
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Appendix  III.  AMEDD  General  Officer  Board 
Final  Prioritized  Major  and  Subarea  Defici 
ency  Lists  Developed  From  Rescaled  Values 
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Casualty  Care/Treatment  Deficiencies 


1.  Casualty  treatment  capability  is  inadequate  to  treat  and  return  large 
numbers  of  sliqhtly  disabled  soldiers  to  battle  and  to  preserve  life  and 
function  among  the  seriously  injured. 

a.  Inadequate  resuscitation  capability  for  mass  casualties. 

b.  Inadequate  medical/surgical  treatment  capability  for  battlefield 
injuries. 


c.  Individual  soldiers'  capability  to  perform  self/buddy  aid  is 

inadequate. 

d.  Inadequate  treatment  regimes  for  directed  energy  injuries. 

e.  Inadequate  capability  for  diagnosis  and  treatment  of  combat  stress 
reactions  and  neuropsychiatric  disorders. 

f.  Medical  professional  and  para-professional  personnel  are  unable  to 
adequately  perform  treatment  tasks  and  operate  field  medical  equipment. 

g.  Inability  to  provide  treatment  and  post-operative  management  of 
maxillofacial  injuries  and  wounds. 

h.  Dental  corps  officers'  ability  to  perform  emergency  medical 

treatment  is  inadequate. 

i.  Whole  blood  substitutes  are  inadequate. 

j.  Poor  dental  health  of  individual  soldiers  results  in  preventable 

dental  casualties  and  their  loss  from  battlefield  engagement. 

k.  The  ability  to  monitor  vital  signs  is  Inadequate  during  evacuation 
in  MOPP  or  cold  weather  conditions. 

l.  Blood  distribution  in  the  theater  of  operations  is  Inadequate. 

m.  Veterinary  corps  officers  and  enlisted  personnel  are  not  fully 

capable  of  performing  requir  ed  veterinary  services  on  the  battlefield. 

n.  Ability  of  dental  personnel  to  function  in  a  battlefield 

environment  and  operate  dental  field  equipment  is  Inadequate. 

o.  Optometry  officers  and  enlisted  personnel  are  unable  to  operate 

their  TOE  equipment  in  the  battlefield  environment. 


Casualty  Prevention  Deficiencies 


2.  Casualty  prevention  services  and  resources  are  inadequate  to  prevent 
disease  and  health  hazards  debilitating  to  the  fighting  force  on  the 

integrated  battlefield. 

a.  Inadequat.  eye  protection  froi.i  high  velocity  fragments  and  high 
intensity  electromagnetic  radiations  results  in  otherwise  preventable 
casualties. 

b.  Preventive  medicine  services  lack  the  capability  to  detect, 

identify,  and  provide  early  warning  of  disease  on  the  battlefield  and  in  the 
individual  soldier. 

c.  Inadequate  recognition,  monitoring,  and  correction  of  health 
hazards  to  crews  and  nearby  friendly  forces  from  military  weapons  and  other 
systems. 


d.  Inadequate  doctrine,  training,  and  medical /mental  health  capability 
for  the  prevention  of  combat  stress  casualties. 

e.  Inadequate  environmental  protection  exists  for  patients  during 
evacuation. 
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Medical  Resource  Deficiencies 


3.  Medical  resources  on  the  projected  battlefield  are  inadequate  to  treat, 
process,  and  evacuate  the  wounded,  injured  and  ill  and  to  reconstitute 
medical  unit  losses. 

a.  Combat  zone  and  COMMZ  medical  treatment  facilities  are  insufficient 
to  meet  the  requirements  of  the  integrated  battlefield. 

b.  COMMZ  level  hospitals  are  incapable  of  augmenting  and/or 
reconstituting  corps  level  treatment  facilities. 

c.  Medical  resupply  support  is  inadequate. 

d.  Clinical  laboratory  requirements  exceea  capability  using  current 
equipment  and  methodologies. 

e.  Current  decontaminants  are  inadequate  for  medical  materiel, 
supplies,  and  equipment. 

f.  Inability  to  identify  professional  and  para-professional  medical 
personnel  with  specialized  skills  using  the  current  MOS  identifiers. 

g.  Medical  units  lack  the  mobility  necessary  to  keep  up  with  supported 
units  due  to  weight  and  cube  of  facilities,  materiels,  and  supplies. 

h.  Inadequate  plans  exist  to  convert  civilian  structures  for  hospital 

use. 


i.  Preventive  medicine  units  are  inadequate’y  organized  for  deployment 
and  function  on  the  integrated  battlefield. 

j.  The  field  kitcien  system  to  provide  medical  food  service  in  the 
theater  is  inadequate. 

k.  Optometry  teams  are  inadequate  to  provide  optometrical  support 
under  current  basis  of  allocation  rules. 

l.  Power  distribution  and  illumination  systems  in  medical  and  dental 
units  are  inadequate. 

m.  Insufficient  veterinary  service  units  exist  to  support  a  total  DOD 
mobilization  force  structure. 
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n.  Medical  food  service  support  at  theater  hospitals  is  inadequate. 

o.  Dental  field  equipment  items/sets  are  inadequate  for  dental 
operations. 

p.  Dental  hygiene  support  at  the  general  hospitals  and  convalescent 
centers  is  inadequate. 

q.  Test,  measurement  and  diagnostic  equipment  for  medical  equipments 
is  inadequate. 

r.  Materiel  handling  equipment  for  medical  supplies  is  inadequate. 

s.  Currently  available  visual  correction/protection  devices  for  the 
individual  soldier  (spectacles,  contact  lenses,  sunglasses)  are  incompatible 
with  battlefield  requirements. 

t.  Current  refrigeration  capability  in  medical  treatment  facilities  is 
inadequate. 

u.  Spectacle  lens  fabrication  capability  in  the  field  is  inadequate. 

v.  Present  assets  to  provide  covered  storage  for  medical  supplies  are 
inadequate. 

w.  Clinical  laboratory  capability  to  provide  the  **equired  high  volume 
of  procedures  is  inadequate. 

x.  Blood  bank  team  organization  does  not  allow  for  completion  of  the 
mission  on  the  battlefield. 

y.  Current  materiels  and  treatment  methodologies  for  maxillofacial 
injuries  are  inadequate  to  provide  responsive  resuscitative  care. 

z.  Current  field  optometry  equipment  is  severely  degraded  by 
environmental  conditions  on  the  battlefield. 

aa.  Blood  shipping  containers  are  inadequate. 

bb.  Veterinary  services  for  the  military  working  dog  on  the  battlefield 
are  insufficient. 
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Casualty  Evacuation  Deficiencies 


4.  Casualty  evacuation  capacity  is  inadequate  to  transport  the  projected 
types  and  numbers  of  battlefield  casualties,  resulting  in  increased 
morbidity  rates  as  well  as  burdening  forward  units'  transportation  resources. 

a.  Air  and  ground  evacuation  vehicles  lack  mobility  capacity  and/or 
survivability  in  forward  areas  of  the  battlefield. 

b.  Ground  ambulances  are  too  few  and  inadequate  to  evacuate  the  large 
number  of  patients  generated  on  the  battlefield. 

c.  Current  field  medical  records  system  on  the  integrated  battlefield 
is  inadequate. 
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Chemical  Injury  Treatment  and  Preventive  Deficiencies 


5.  Medical  treatment  and  prevention  of  injuries  in  a  chemical  environment 
are  inadequate  to  return  casualties  to  the  battlefield  or  to  preserve  the 
lives  of  projected  numbers  of  chemical  casualties. 

a.  Chemical  prophylaxis,  antidotes,  and  therapeutics  are  inadequate. 

b.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  chemical  contamination. 

c.  Capacity  to  decontaminate  patients  and  medical  supplies  and  equip¬ 
ment  is  inadequate. 

d.  MOPP  decrements  medical  personnels'  ability  to  treat. 

e.  Medical  equipment  and  supplies  are  rendered  non-usable  by  chemical 
contamination. 

f.  Inadequate  collective  protection  shelters  exist  for  medical  units' 
treatment  of  chemical  casualties. 

g.  Medical  materiel  packaging  is  inadequate  to  protect  against 
chemical  contamination. 
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Medical  Command,  Control,  and  Communications  Deficiencies 


G.  Medical  command,  control,  and  communication  are  inadequate  to 
coordinate  essential  medical  units’  activities  at  all  levels  cn  the 
integrated  and  electronic  warfare  battlefields. 

a.  Major  deficiencies  in  exist  in  the  absence  of  the  following 
systems: 


PLRS/JTIDS  Hybrid 

SINC6ARS 

IHFR 

TACCS 

DAS-3 

TAMM IS 

CSS/CCS 

b.  The  command,  control,  and  communication  of  medical  regulations  on 
the  battlefield  are  inadequate. 

c.  Dedicated  medical  intelligence  assets  are  unavailable  to  acquire 
and  process  critical  data  on  disease/CBR  threats  at  division  and  corps 
levels. 

d.  Insufficient  linguistic  resources  currently  exist  within  the  AMEDD 
in  Russian,  Russian  satellite  (Eastern  European),  and  mid-eastern  foreign 
languages  to  provide  medical  intelligence  essential  to  friendly  forces  on 
the  battlefield. 
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Biological  Injury  Treatment  and  Prevention  Deficiencies 


7.  Medical  treatment  and  prevention  of  injuries  in  a  biological 
environment  are  inadequate  to  protect  the  force  against  mass  epidemics  due 
to  threat  BW  agents  and  to  conserve  its  capacity  to  fight. 

a.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  biological  contamination. 

b.  Biological  prophylaxis,  antidotes,  and  therapeutics  compounds  are 
inadequate. 

c.  Medical  materiel  packaging  is  inadequate  to  protect  against 
biological  contamination. 
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Nuclear  Treatment  and  Prevention  Deficiencies 


8.  Medical  treatment  and  prevention  of  injuries  in  a  nuclear  environment 
are  inadequate  to  function  effectively  in  radioactive  areas  and/or  to  return 
to  duty  or  preserve  life  of  projected  nuclear  blast/burn/radiation 
casualties. 

a.  Radiological  prophylaxis,  antidotes,  and  therapeutic  compounds  are 
inadequate  for  projected  needs. 

b.  Medical  units  lack  detection  equipment  to  identify  and  quantify  the 
type  of  radiological  contamination. 

c.  Medical  materiel  packaging  is  inadequate  to  protect  against 
radiological  contamination  and  EMP. 


Appendix  IV.  Examples  of  Mission  Area  Analysis 
Corrective  Actions  for  The  Top  Two  Deficiency  Areas 
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MISSION/TASK 


DEFICIENCY 


Provide  timely  and 
efficient  patient  treat¬ 
ment  and  hospitalization 
in  the  theater  of  opera¬ 
tions. 


1.  Casualty  treatment  caoacity  is  inadeouate  to  treat 
and  return  large  numbers  of  slightly  disabled  soldiers  to 
battle,  and  to  preserve  life  and  function  among  the 
seriously  wounded. 
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CORRECTIVE  ACTIONS 


ANALYSIS 


Require  an  integrated  systems  approach  for..resuscitation  (D-l)  Chapter  2 

Para  2-3 

Augment  training  to  enable  effective  utilization  of  state  of  art 
and  near  term  technological  advances  (T-l) 

Incorporate  present  state  of  art  materiel  and  other  near  term 
5  yBP2rt_a0d_noni  tori  ng_sys  terns  _ 


Develop  a  small,  light,  portable  oxygen  generation  system,  and  Chapter  3 
compatible  oxygen  delivery  system  (M-2;  j  Para  3-17 


Develop  expanded  biophysiological  data  bases  for  all  injury  Chapter  2 

categories  to  enable  doctrinal  changes  (M«3)  Para  2-4 


Alter  present  training  programs  to  Incorporate  new  knowledge  (T-2) 

Replace  orthooedlc  surgeons  at  MASH  units  with  general  surgeons 

19=iJ 


Require  periodic  training  reinforcement  as  a  command  responsibility  Chapter  2 
(D-2)  •  Para  2-6 

Add  psychological  support  training  to  first  aid  task  list  for  the 
individual  soldier  (T-3) 

Develop  exportable  training  packet  to  facilitate  initial  and 
periodic  reinforcement  of  training  for  trainers ,{T-4) 

Identify  or  develop  audiovisual  scenarios  to  facilitate  rein¬ 
forcement  of  training  (Step)  for  individual  soldier  (T~5) 

Provide  idequate  materiel  for  hands  on  training  (J*-4) 

Develop  appropriate  chemical /biological  prophylaxis  and  antidote 
( M—  5 ) 

Develop  self/buddy  aid  equipment  compatible  with  MOPP  IV  (M-6) 

Augmentation  of  first  aid  kit  to  include  anitshock  drugs  and 
better  hemostatic/anti-infection  wound  coverings  (M-7) 


Make  doctrinal  decisions  Immediately  to  give  direction  for  troop 
_  tra  j  ni  ng__(p-  3J _ _ _ _ I. _ _ _ _ _ __ 


CORRECTIVE  ACTIONS 

ANALYSIS 

Decision  at  OTSG  level  to  revise  AOHMP  to  tie  dental  health  status 

Chapter  5 

of  combat  and  other  units  to  readiness  status  (D-4) 

Para  5-28 

Train  commanders  on  imoact  of  dental  casualties  on  unit  oerformance 
(T-6) 

Provide  definitive  dental  treatment  either  during  3CT  or  AIT, 
between  or  after  AIT  (T-7 

RDF  units  should  be  in  combat  ready  dental  status  (T-8) 

Reinstitute  a  Dental  Combat  Effectiveness  Program  with  emphasis  on 

definitive  dental  care  throughout  the  Army  with  priority  to  combat 
units  (T-9) 

Develop  and  implement  an  Army  standardized  dental  "At-Risk  Profile" 
to  meet  mission  essential  needs  (T- 10 ) 

Develop  biophysical  data  base  of  nonionizing  radiation  injury  (M-8) 

Develoo  doctrine  for  avoidance,  protection,  and  treatment  of  injury 

Chanter  2 

Para  2-2 

(D-5)  ' 

Develoo  training  program  based  on  doctrine  for  self  aid/buddy  aid 

to  include  psychological  stresses  (T-ll) 

Develoo  training  program  based  on  doctrine  for  all  levels  of 
medical  treatment  personnel  (T-12) 

Develop  eye  orotecti on/body  protection  for  nonionizing  radiation 

injuries  (M-9) 

Develop  treatment  materiel  for  such  Injuries  (M-10) 

Develop  medical  management  programs  for  such  Injuries  (T-13) 

Develop  and  publish  operational  doctrine  for  combat  psychiatry  and 

Chapter  2 

mental  health  services  to  provide  better  prevention  and  more  timely 
diagnostic  and  treatment  capabilities  in  forward  areas  (D-6) 

Increase  training  of  officers  and  NCOs  Army-wide  for  prevention, 
early  recognition  and  basic  management  of  combat  stress  (T-14) 

Increase  training  of  all  relevent  paramedical  and  medical  personnel 
(including  mental  health  personnel)  for  specific  skills  in  prevention, 
differential  diagnosis,  and  treatment  roles  (T-15 ) 

Para  2-5 

' 

CORRECTIVE  ACTIONS 

ANALYSIS  ' 

'•  ’  • 

Identify  personnel  with  mental  health  SSIs-for  assignment  to 
critical  location  (0-2) 

con't  Chapter  2 
Para  2-5 

ri 

Increase  differential  diagnostic  skill  and  prevention/treatment 
capability  at  brigade  medical  company  (forward)  by  mobilization 
assignment  of  a  psychiatrist  (SOW)  as  one  of  the  physicians;  increase 
duties  and  rank  of  the  senior  full  time  behavioral  science  specialist 
(916)  (0-3) 

j  m 

Increase  capability  in  the  division  mental  health  section  by 
addition  of  an  £-8  NCOIC  (91G),  plus  augmentation  by  skilled  personnel 
in  wartime  (0-4) 

1 

Improve  capability  throughout  corps  area  by  augmenting  MTF's  and  by 
designating  minimum  one  mobilization  OM  Team  (psychiatric  augmentation 
per  corps  with  clear  peacetime  and  combat  doctrine  (0-5) 

'  ' 

r  ‘  'i*  ■ 

i  '• 

Deploy  CONUS  OM  Teams  and  convalescent  centers  early  in  the  TPFD  to 
CZ  and  COMMZ,  augmented  with  additional  resources  such  as  occupational 
therapists  (0-6) 

\  ’  '  • 

\  .  '/ 

\ 

\  - 

V 

Develop  improved  diagnostic  .criteria  through' research,  to  include 
field-portable  laboratory  tests- where  practical*  to  differentiate 
organic  brain  syndromes,  “hysterical"  conversion  reactions  due  to 
stress,"  and  true  CBR  and  laser  injuries  (M-ll) 

'  A 

1 

Review  and  update  drug  treatment  resources  in  forward  units  (D-7) 

• 

\ 

■ 

Develop  improved  drugs  to  promote  brief  sleep,  reduce  anxiety, 
control  aqitation.  and  treat  specific  organ  disorders  (M-1Z) 

1 

* 

1 

I 

1 

1 

1 

1 

i 

) 

i 

i 

i 

i 

"  ■ 

Increase  field  medical  training  for  all  AMEDD  personnel  (T-16) 

Chapter  2 

Para  2-7 

Alter  priorities  of  AHS  to  emphasize  field  medical  education  and 
training  (D-8) 

-  ’  ' 

Conduct  cross  training  of  paramedical  personnel  to  secondary  and 
tertiary  MOS  levels  and  identify  this  by  additional  skill  identifier 
(T-17) 

1 

Develop  realistic  training  materiels  for  continued  periodic 
individual  and  unit  training  (M-13) 

i  ' 

Increase  the  number  of  authorizations  for  training  oral  and  maxi-' 
llofacial  surgeons  (63N)  (T-18) 

Chapter  5 

Para  5-22 
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CORRECTIVE  ACTIONS 

ANALYSIS 

' 

Change  current  TOE  of  CSH  and  EVAC  hospitals  to  add  one  general 
dentist  (638)  and  one  dental  lab  specialist  ( 4-2D )  as  a  minimum  (0-7) 

con't  Chapter  5 
Para  5-22 

/  y 

/  • 

Change  TOE  of  CSH  and  EVAC  to  add  a  limited  dental  lab  equipment  sc 
to  support  fabrication  of  surgical  appliances  (0-8) 

/ 

/  / 

Develop  an  acceptable  oxygen  carrying  blood  substitute  (M-14) 

Chapter  7 

Para  7-6 

Decision  at  OTSG  level  to  fully  implement  adequate  field  medical 
training  in  conjunction  with  AMEDD  personnel  (T-19) 

Chapter  5 

Para  5-23 

Dental  personnel  participate  in  the  Combat  Casualty  Care  Course 
(T-20) 

. 

Establisn  trauma  training  programs  for  dental  officers  at  every 
■  dental  unit  in  conjunction  with  MECDAC/MEDCEN  under  a  POI  from  AHS 
(T  21) 

,s 

Rotate  dental  officers  througn  hospital  facilities  to  receive 
training  in  those  ar-eas  identified  (T-22) 

Change  SSI  of  63A9D  for  personnel  assigned  to  unit  dental  supoort 
(0-9) 

Advanced  trauma  life  support  training  must  be  a  continuing  train¬ 
ing  program  (T-23) 

?  • 

■  / 

Establish  doctrine  for  a  blood  distribution  system  (D-9) 

Chapter  7 

Para  7- 1 

‘ 

r  ■ 

S' 

/  • 

7  ■ 

Implement  adequate  field  veterinary  training  for  all  veterinary 
service  personnel  (T-24) 

Develop  field  veterinary  training  programs  in  support  of  major 
'  regional  FTXs  (T-25) 

Chapter  4 

Para  4-39 

/ 

.  $>. 

/■/ 

; 

I 

Develop  a  non- invasive  vital  signs  monitor  (M-15) 

Train  user  personnel  on  above  equipment  (T-26) 

Chapter  3 

Para  3-9 

Implement  meaningful  field  training  for  all  AMEDD  dental  personnel 
(T-27) 

Chapter  5 

Para  5-27 
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CORRECTIVE  ACTIONS 


ANALYSIS 


Authorize  and  fund  necessary  field  dental  equipment  for  each  dental  con't  Chapter  5 
organization  (0-10)  Para  5-27 

Eliminate  unnecessary  and  non-mission  essential  annual  training 
requirements  (T-28) 


Provide  realistic  combat  field  training  for  division  optometry  '  Chapter  10 
sections  with  only  TOE  equipment  (T-29)  Para  10-11 

Fully  staff  and  equip  teams  OH  (0-11) 


MISSION/TASK 


DEFICIENCY 


Provide  preventive 
medicine  services  on  the 
battlefield  by  reducing 
the  individual  soldier's 
exoosure  to  disease  and 
other  environmental 
hazards. 


2.  Casualty  prevention  services  and  resources  are  in¬ 
adequate  to  prevent  disease  and  health  hazards  debilitating 
to  the  fighting  force  on  the  integrated  battlefield. 


CORRECTIVE  ACTIONS 


ANALYSIS 


Train  soldier's  to  use  protective  eye  armor.  (T  30} 

Acquire  combat  spectacles  (M-16) 

Purchase  spectacle  lens  edging  equipment  for  optical  labs  and  all 
optical  fabrication  units  (M-17). 

Issue  combat  spectacles  to  every  soldier  (0-10) 


Conduct  training  on  laser  radiation  threat  (T-31) 

Utilize  monocular  devices  to  minimize  simultaneous  loss  of  vision 
in  both  eyes  (M-18) 

Develop  protective  eye  armor  for  laser  radiation  (M-19) 


Chapter  10 
Para  10-6 


Chapter  10 
Para  10-7 


Provide  training  on  nuclear  flash  threat  and  protection  (T-32) 
Develop  protective  eye  armor  for  nuclear  flash  (M-20) 


Chapter  10 
Para  10-8 


Increase  training  in  the  development  and  use  of  tactical  medical  Chapter  .6 

Intelligence  to  provide  early  warnings  of  disease  outbreaks  (T-33)  Para  6-3* 

Develop  doctrine  on  collection,  dissemination  and  use  of  medical 
intelligence  relating  to  endemic  diseases,  dysfunction  injuries  and 
biowarfare  agents  (D-ll) 

Change  doctrine  on  the  tactical  use  of  PVTMED  teams  to  collect  and 
disseminate  medical  intelligence  data  (D- 12) 

Increase  the  number  of  epidemiologists  in  the  tactical  area  (0-12) 

Develop  a  realtime  tactical  disease/dysfunction/injury  data 
collection  system  that  will  be  used  (M-21) 


Develop  equipment  to  rapidly  Identify  actual  disease  non  battle 

Chapter  6 

Injury  agents  (M-22) 

Para  6-4 

Develop  a  system  for  rapid  diagnoses  of  infectious  disease  and  bio 
warfare  agents  (M-23) 

Develop  a  system  to  rapidly  Identify  potential  bio-warfare  agents 
and  endemic  diseases  of  military  Importance (M-24) 

/ 


CORRECTIVE  ACTIONS 

ANALYSIS 

Provide  doctrine  as  to  requirements  for  combined  or  separate 
natural/artifical  environmental  protection  (D-13) 

Chapter  2 

Para  2-11 

Provide  doctrine  as  to  whether  to  use  disposable  or  reusable  pro¬ 
tection  'dun ng  evacuation  (D- 14) 

Develop  environmental  protective  devices  for  patient  evacuation 
(M-25) 

Determine  levels  at  which  blast  overpressure  causes  auditory  and 
nonauditory  injury,  .evaluate  the  probability  that  certain  current  and 
proposed  weapons  systems  will  cause  such  injury,  and  determine  option¬ 
al  procedures  for  preventing  such  injury  (D-15) 

Chapter  6 

Para  6-5 

Determine  the  short-  and  long-term  effects  of  exposure  to  combat 
vehicle  noise  and  vibration  upon  crew  health  and  performance  and 
recommend  appropriate  means  of  ameliorating  the  impact  of  these 
effects  (D-16) 

Determine  the  effects  of  heat,  cold,  high  terrestrial  altitude, 
diet  and  their  interrelationships  upon  health  £nd  performance,  both 
inside  vehicles  and- outside,  and  develop  and  evaluate  prophylactic 
measures  to  reduce  the  impact  of  adverse  effects  (tf-26) 

Determine  the  requirements  for  life  support  biotechnology  and 
impact  protection  in  Army  combat  vehicles  and  recommend  optimal 
methods  for  meeting  the  requirements  <M-27 ) 

•  * 

Determine  the  effect  of  human  exposure  to  electromagnetic  radia¬ 
tion  (lasers  microwaves  and  millimeter  waves)  and  recommend  safe 
exposure  levels  ( D- 17 ) 

Assess  the  long-  and  short-term  health  effects  of  toxic  chemicals 
to  which  Army  personnel  and  civilian  employees  are  exposed  and 
recommend  safe  exposure  levels  (D-18) 

Develop  dietary  measures  which  will  extend  the  use  of  operational 
rations  and  maximize  work,  psychomotor  and  mental  performance 
effectiveness  during  rapid  deployment  and  sustained  operations  in  all 
environmental  extremes  (M-23) 

Evaluate  the  effects  of  combat  stress  upon  individual  and  unit 
mental  health  and  cohesion  and  develop  prophylactic  measures  to 
reduce  the  number  of  psychiatric  casualties  (M-.29) 

Evaluate  the  physical  requirements  applicable  to  specific 
military  tasks  and  determine  the  physical  and  psychological  limita¬ 
tions  which  affect  soldier  performance  during  sustained  operations  In 
order  to  recommend  ohysical  standards  and  staffing  ratios  (D-19) 
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CORRECTIVE  ACTIONS 


ANALYSIS 


Assess  the  levels  of  sensory  enhancement  (predominantly  of  the  con't  Chapter  6 

visual  and  auditory  senses)  required  on  the  battlefield  in  order  to  Para  6-5 

provide  maximum  information  to  the  soldier  (night  vision,  communica¬ 
tions  information  display,  etc.)  and  recommend  the  most  effective 
means  of  providing  it  (M-30) 


Accomplish  army-wide  policies  which  increase  unit  cohesion,  de- .  Chapter  2 
crease  turbulence,  promote  realistic  conventional  and  NBC  training,  Para  2-5 
minimize  drug  and. alcohol  abuse,  insure  physical  fitness,  and-  provide 
stable  family  "home  fronts"  (0  20) 

Develop  and  publish  operational  doctrine  for  Combat  Psychiatry  and 
Mental-  Health  Services  to  provide  better  prevention  of  factors  which 
contribute  to  combat  stress  casualties  (Q-21) 

Increase  training  of  officers  and  NCO's  Army-wide  for  prevention, 
early  recognition  and  basic  management  of  combat  stress  (T-35) 

Increase  training  of  all  relevent  paramedical  and  medical  personnel 
(including  mental  health  personnel)  for  specific  skills  in  prevention 
of  combat  stress  casualties  (T-.36)  ' 

-  ' 

Increase  combat  stress  casualty  prevention  capability  at  Bde  by 
increasing  duties  and  rank  of  the  brigade  senior  Beh  Sci  Sp  (91G)  - 

(D-22) 

Involve  Div  Mental  Health  Sections- in  unit  field  exercises, 
command  consultation  and  teaching  rather  than  be  absorbed  into 
MEDDACs  (D-23) 

Increase  preventive  capability  in  the  Div  Mental  Health  Section  by 
addition  of  an  E  8  NCOIC  (91G)  (0-13) 

Improve  preventive  capability  throughout  corps  area  by  designating 
one  mobilization  0M  Team  (Psychiatric  Augmentation)  per  corps  with 
clear  peacetime  and  combat  doctrine  (0-14) 

Develop  Improved  behavioral  methods  and  drugs  to  promote  brief 
sleep  and  control  anxiety  (M-31) 
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Appendix  V.  Background  and  Perception  Assessment  Questionnaire 


INSTRUCTIONS:  Please  complete  all  of  the  questions  below.  Where  appiopriate 
indicate  your  response  with  an  X' .  Section  I  requests  biographical  information 
which  will  be  used  to  construct  a  profile  of  expert  board  member  characteristics. 
Section  II  requests  your  perceptions  of  the  outcomes  of  board  activities. 


SECTION  I.  BIOGRAPHICAL/EXPERIENCE  DATA 


2.  Age: 


years 


3.  Gender:  Male  j  j 

Female  j  j 


4.  Education:  Degree(s) 

- -  (if  any) : 


years 


5.  Organization: 


6.  Total  active 

7.  Your  experience 

military  experience: 

in  AMEDD  units: 

9 •  Military 
Grade : 


10.  Your  experience  in: 

TDA  TOE 

Units  — — * -  lln-lt-a  - - 


years 


TOE 

Units 


11.  Combat  experience: 
(if  any) 


mm 

years  months 


years 


Location: 


SECTION  II.  EXPERTS'  PERCEPTIONS  OF  ITEM  ACTIONS  AND  OUTCOMES 


For  the  following  items  please  indicate  your  response  by  placing  an  "X" 
in  the  appropriate  box.  Please  complete  all  items.  DO  NOT  OMIT  ANY. 


Overall,  how  do  you  view  your 

Overall,  how  do  you  view  the  revised 

item  ranking  decisions? 

group  item  ranking  decisions? 

C  3  1.  Extremely  unsure 

C  3  1.  Extremely  unsure 

C  3  2.  Very  unsure 

C  3  2.  Very  unsure 

C  3  3.  Somewhat  unsure 

C  3  3.  Somewhat  unsure 

C  3  4.  So-so 

C  3  4.  So-so 

C  3  5.  Somewhat  confident 

C  3  5.  Somewhat  confident 

C  3  6.  Very  confident 

C  3  6.  Very  confident 

C  3  7.  Extremely  confident 

[3  7.  extremely  confident 

Overall,  I  regard  item 

Overall,  I  regard  the  revised  group 

ranking  decisions  as: 

item  ranking  decisions  as: 

C  3  1.  Extremely  inaccurate 

C  3  1.  Extremely  inaccurate 

C  3  2.  Very  inaccurate 

C  3  2.  Very  inaccurate 

C  3  3.  Somewhat  inaccurate 

[3  3.  Somewhat  inaccurate 

C  3  4.  So-so 

C  3  4.  So-so 

C  3  5.  Somewhat  accuarte 

C  3  5.  Somewhat  accurate 

[3  6.  Very  accurate 

C  3  6.  Very  accurate 

C  3  7.  Extremely  accurate 

C  3  7.  Extremely  accurate 

Ill 


Overall,  how  was  your  expertise 
utilized  in  the  ranking  of  items? 


Overall,  how  was  the  expertise  of  the 
board  utilized  in  the  ranking  of  items? 


C  3  i.  Not  at  all 
C  3  2.  Very  little 
C  3  3-  Fairly  well 
C  3  4.  Qui te  well 
C  ]  i.  Very  well 
C  3  o.  Excellently 
CD7.  Perfectly 


C  3  1.  Not  at  all 
C  3  2.  Very  little 
C  3  3.  Fairly  well 
C  3  4.  Quite  well 
C  3  5.  Very  well 
C  3  6.  Excellently 
C  3  7.  Perfectly 


Overall,  how  do  you  view  your 
item  ranking  decisions? 


Overall,  how  do  you  view  the  revised  group 
item  ranking  decisions? 


C  3  1.  Extremely  dissatisfied 

C  3  2.  Very  dissatisfied 

C  3  3.  Somewhat  dissatisfied 

C  3  4.  Neither  dissatisfied  nor  satisfied 

C  3  5.  Somewhat  satisfied 

C  3  6.  Very  satisfied 

C  3  7.  Extremely  satisfied 


C  3  1.  Extremely  dissatisfied 

C  3  2.  Very  dissatisfied 

C  3  3.  Somewhat  dissatisfied 

C  3  4.  Neither  dissatisfied  nor  satisfied 

C  3  5.  Somewhat  satisfied 

C  3  6.  Very  satisfied 

C  3  7.  Extremely  satisfied 


Results  from  the  board  will  be  made  available  to  you  upon  completion  of 
a  technical  report.  If  you  wish  to  provide  any  written  comments  regarding 
the  use  of  the  Iterative  Decision  Method  and/or  the  Mission  Area  Analysis 
deficiency  ranking  process  please  use  the  space  provided  below. 
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